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A SURVEY OF PROBLEM PUPILS 
GERTRUDE HILDRETH 
Lincoln School of Teachers College, Columbia Uniwersity 

In every school there are pupils whose behavior is erratic, pe- 
euliar, or abnormal, whose accomplishment does not measure up to 
capacity or whose ability Is unequal to the tasks imposed. Some 
pupils persist in the retention of infantile habits long after most 
children have reached more mature stages of development. Others 
have developed undesirable aftitudes which prevent them from 
making worth-while contributions and rational adjustments to the 
situations of both school and home. Some pupils have parents who 
hinder rather than help them in making normal adjustments. All 
of these pupils constitute problems which the average teacher has 
to meet. Such pupils frequently consume a disproportionate 
amount of the teacher’s time, for they usually make uneconomical 
ise of their own time and distract other pupils by their peculiarities. 

As educators, we owe certain obligations to these pupils. Such 
problem pupils or behavior deviates should be detected at the earliest 
possible moment. Adequate diagnosis of the difficulties of such 
pupils should then be made, and remedial treatment and educa 
tional guidance should be arranged. At the Lineoln School of 
Teachers College an effort is being made to meet these obligations. 


Since at the time of writing only the first stage of the work, that of 


detecting the pupils to be diagnosed, had been completed, this dis- 


cussion must be limited to the description of the methods used, the 
tabulation of the varieties and frequencies of the difficulties, and a 
summary of the facts discovered about problem pupils 

In the detection of a problem pupil, several sources of informa- 
tion and evidence must be utilized. The judgments of teachers who 
come in contact with him daily are of great value. Questionnaires 


££) 


filled out by parents giving detailed information about the pupil’s 
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background, physical condition, and the like, } 


data, while psychological-test 


iluable source of information for assist 


in the detection of behavior deviates. 


urvey was conducted by the psychologist’s department, in 


teachers in the detection of prob 


ireulars Stating the purpose ol the Survey and re 
i . 


oO! information about problem pupils were 


elementaryv- and high-sehool de part 


rive | \ mv ¢ t he ere ilar follow } 
SURVEY OF PROBLEM PUPILS IN THE LINCOLN SCHOOL 
‘ ! ye CO Or AFF 
4 purposes for conducting this survey: (1) the immediats 
~ ssisting st iff mer ers in the iscovery, diagnos S 
r fienlties of | blem pupils 2) the more remote 1 
0 ta ord to ati the facts al t proble m pupils 
‘ ‘ ' 
t t gm « treatment the light of the results obtained 
t S : hild may nstitute a problem who belongs : 
l P s who markedly deficient in one or more of the skills or tool sub ' 
i s as com] ed with the average pupil in the same class, 
Those whose behav terferes with class work; such as anti-social 
uti ils al those who are relatively undeveloped in 
} et | traits 
| s wi general to i reasonable a of progress—ve 
t rk far below capacity b ng to this class. 
1 P ! I . i your ’ ion, would make better adjust 
. _ 
* s queer’’ hy teachers parents, and other pupils, whose 
Ss Ul progres er than that of others; those wl 
t ~ extremely self-conscious; have feelings of in i 
t t hs S en! excessively those with indesirable 
} 
( P ing g e+ al rmal home conditions: problem cases 
ents refus r ar nable to cooperate: cases in which ti f 
el ) t } 
i: P S ficulties appe to be d ' iril physical defects sucl 
t fective vis 1 the like 
; @ ire i ry ir ¢ ’ enietT ‘ 1 re prol le m cases 
| eacl} hild T , , ‘ prehensive vour report 
: = , 
S the school phvsician and psvehologist were affixed 
to this . Several blanks for recording pupils’ names and 
. , .° an 
leseribing their difficulties were attached to each cireular. 











what constitutes a problem ease. This list was d 





1928] A SURVEY OF PROBLEM PUPILS 


[he form of the questionnaire was: 


THE LINCOLN SCHOOL OF TEACHERS COLLEGI 


INFORMATION ABOUT PROBLEM PUPILS 


WEITTTTITITI TTT ETT TTT Grade..... 
Why do you consider this child a problem? 
Have you diseussed the diffi ilty with parents, teachers, 
vsicians, psychologists? If answer is ‘‘ yes,’’ licate whom y 
rs ing the appropriate words When did the ss 
? 
Were recommendations made?.......... What were they?. 
t+. Were recommendations carried out?...... What was ?. 
Do you think a conference with eve yone concerne mn the 
? 
6. Do vou feel that vo dv eas } 
A the ficultv and calf? 
Ha suggestions to make that v 
| ee What are, the hat dcte rs 
. \ tional re rks 
~ d D 


\dequate space was left between each question to provid 


rhe classification of problem pupils, as stated in the not 


+ 
| 


eachers, was intended to give the teachers some suggestions 


ig rived au 


riter’s experience with normal and abnormal school childre 


} 


m classifications Ol others who have Cc nducted sim lar sur 


\ me 


; 


re comprehensive list might be devised in eooperation 


hers and administrators. Teachers frequently overlook ¢ 


es of problems unless their attention is ealled to then 

hers, for example, consider a child who does good schoo 

whom tests reveal to be working far below capacity, 
Some teachers fail to see in the unusually quiet, well-balance: 


oblem which mental or physical tests reve (Conse 


isking teachers to report problem cases the possibility 


‘e of various types of problems which they might ot} 


neglect should he diseussed with the m 


The survey was conducted twice during the past vear, li 


Nove mber. A tte r the data she TS were ASSt mi} “| charts 


] 


nstructed for the elementary- and high-school departments 


i 











{ JOURNAL OF EDUCATIONAL RESEARCH [ Vol, 18, No.1 


rately, setting forth the name of each pupil, his life age, menta 


: 
! 


ve, Stanford-Binet intelligence quotient, grade, the name of th 
person from whom the information was obtained, the nature of th 
difficulty, suggestions for correction of the difficulty, and the fur 


er recommendations for diagnosis and treatment made by th 


‘hologist . few eases were included in the tabulation whic} 
were reported by parents or discovered independently by the ps; 
chologist but which were not reported by teachers A tew eases wert 

so included which were reported to the psychologist verbally by 
teachers before the survey was undertaken. Pupils who were cor 


dered problems primarily because of poor accomplishment in on 


re school subjects without other complications were not i 
eluded in the tabulation. A separate investigation of these pupils 
was made. and the facts about their deficiencies were immediate!) 


reported to the principals of the elementary- and high-school di 


irtments The following excerpts, which summarized the dat 
hout seve! nroblem pupils. were taken from the original charts 
; 
( 1] [4 ‘ g ' t} TO, 17 
‘ y ; thie t ] vaa | } " ++ tive 
+ et a! ; +} ‘ HW em he 
Q P — ) = clever evas 
he wit t en that ft 
ac} ( not Ww 
A f 1 ‘ it was re | 
‘ S » nutrition exrm 
xica might be pres 
‘ ‘ et should 
+} ; 
( \ { ‘ t TO. 109 
af 63 . show ‘al beha 
heen 1 ed for several vears The home situation was 
blu ff led nsibilities. 7 


Much had already been don 
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hap] over his school work He was deficient in the tool sub 
ects and lacked background in common with other pupils. It was 
suggested that the boy should not be expected to do so much as tl 


f his grade and also that he should be made to realize that 


e standard of accomplishment set for him was that he do as mucl 
as he was able. This child had much talent in musi He will w 
tedly become a professional musician. He should, therefore, have 
ry encouragement to attain success in this career 
' g 
( VIII: WA, thirtee vears eleven n ths IQ, 108 

! te é reported that this pupil showed emotional instability, 

S rt tention span, did 7 scr | work, and seemed unawaré 


vant remarks. It was recommended that a complete case 


TABLE I 


NuMBERS OF Boys AND Girus LISTED As : 
PROBLEM Cas! 


Hien Scroor ELEMENTARY 
ScHOool 
' 

Boys Girls Boys Girls 

I 2 3) 4) 5 

April ry 12 4 10 } 
N ¢ er sur \ s 10 19 ) 
Both rv 20 1Y ov S 


lhe total number of cases reported in the April survey was 34; 
November, 42. The total school population was about five 
hundred. The percent of problem pupils reported in April in terms 
of the total school population was approximately seven; in No 
mber wut eight pereent. There is no reason to suppose that 
the Lineoln School had a larger percent of problem pupils than an) 
other institution, but at the Lincoln School every effort was mad 
o discover the problem child and to provide for his individua 
need \ more thorough investigation might have revealed mort 


in have actually been reported in the survey. \ tabu 


} 


n of totals for the two sexes, s¢ parate ly, reveais the laects shown 
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Although there was some variation in the actual number of 
ses in the two surveys, the proportions ot boys and girls reported 
: both surveys were similar. Although in the high school approxi 
itely equal proportions of problems were reported for the two 
exes, in the elementary school the boys outnumbered the girls 
re than three to one. Although the number of cases reported 
the separate surveys was small—and these might appear to be 


nee results—there was marked consistency between the results 


TABLE II 


DISTRIBUTION OF PROBLEM PUPILS THROUGHOUT THE GRADES 


Both I el 
April November Surveys Total Sct 
Ss ey Survey ( ibined Populati« 
ach Gra 
Perce I Percent n N em De 
l 2 ; 4 


{ de | 5.5 1.7 6.5 7.5 
Grade I] 8.8 9.5 9.2 7.5 
Grade III 2.0 2.3 2.0 S.5 
Grade IV 5.8 0.5 78 10.5 
Grade \ 8.8 19.0 14.4 6.6 
{ le VI 2.9 11.9 i.8 i.0 
High school 
Grade VII 26.0 14.0 19.7 12.4 
Grade VIII 14.6 16.6 15.7 10.1 
Grade IX 11.7 0.5 10.5 g8 
Grede X 8.8 2.3 5.2 6.6 
Grad XI x S 
Grade XII 7 


the two surveys and the totals. Conclusions regarding the causes 


or t} 


he differences in { 


the sexes between the ele 


the proport ions ot 


tary and high schools would be unwise unt | further research 


peen unde rtake n. The re Was a slicht EXCeSS OI boys Ove! girls 


the total enrollment in the high school, and a somewhat greater 


isproportion in the elementary school In the high school, the 
oportion of girls to boys was 9.7 to 10; in the elementary school 
Sto 10 This difference was not great enough to explain the dis 
roportionate number ol boys reported ul problems in the ele 


mentary school. 








8 JOURNAL OF EDUCATIONAL RESEARCH [ Vol. 18, No. 1 


The distribution of problem pupils by grades is given in Table 
II. The results for both surveys combined show that the fifth, 
seventh, and eighth grades contain the largest percentages of pupils 
reported as problems. The percent ot problem cases is somewhat 
larger than the actual pereent of pupils of the total school popula 
tion in each of these grades. For the fourth grade, a small percent 
of problem cases was reported as compared with the percent of all 
pupils actually in the fourth grade. The causes of these dis 
erepancies may be due, in part, to variations in teachers’ interest 
in the survey from grade to grade; or they may be due to the fact 


+} t+ mor 
nat mM 


( problems are to be expected in the upper elementary 


TABLE II] 


AGEs OF THE PROBLEM PUPILS 


\ Years Eleme ry | HighS Total 
School 
2) 3 i 
—- 7 12 12 
8-10 22 l 23 
L1-13 ; 26 29 
14-16 12 12 
17-19 
Median Y—3 13-4 11-4 


grades and in the first two years ol high school than in the other 


he distributions of the chronological ages of the problem pupils 
n both surveys are given in Table III. The median ages of all 
pupils enrolled in Lineoln School may be compared with the 
lian ages given in this table. The median ages for the total 


enool population are 


Media 

Ag 
Elementary school... ..... .. 8-8 
NS FPPC Te 14-1 
Total school population......... 11-4 


Although the median age of problem pupils in the elementary 


chool is slightly older and the median age of the high-school prob 


lem pupil slightly younger than the median elementary- or high 
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hool pupil in the total school population the median age Ol all 
lem pupils reported is just equal to the median age of all 
s enrolled in Lineoln School. The Stanford Binet intelligence 
tients of the members of the two survey groups are combined in 
requencies given in Table IV. 

When the 76 problem pupils are classified into three groups on 


isis of their intelligence quotients the following pereents fall 


ich group are found: 


Intelligence 


ee 38.1 
ETE E Se 43.4 
ol ot 18.4 


[These percents differ widely from those for similar intelligence 


emit groups in the total school population. The pereents {o1 


e entire school, recently computed, ar 


t 


, Intelligence 
Quotients Percent 
ANP 13.4 
' SL a s. nainlenedwbitr 53.2 
a re 53.2 


figures show that the child in the general population of this 
hool with an 7Q of less than 105 is comparatively rare as con 

sted with pupils with higher intelligence quotients. It appears 

m the percents for the group of problem pupils that the child 

th an /Q of less than 105 is more apt to be reported as a problem 

chance selection would allow. It is also true that the child 

an IQ of less than 125 is less apt to be reported as a problem 

n we would expect [rom chance selection. The percent of prob 
n pupils with 7Q’s of less than 105 is almost three times as great 
the pereent of pupils below 105 in the total school population 

On the other hand, although the school population contains 33 per 


upil group 


t of pupils with 7Q’s of more than 125, the problem-p 
itains only about half as large a percent of pupils belonging to 
s class. The percent of problem pupils with /Q’s between 105 


124 is slightly smaller than the percent of such pupils in the 


ole sehool population. The median intelligence quotient for 
the entire group is about 119. For the group of problem pupils the 
median is 110. The difference is almost twice as large as the 
robable error of the test. 
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Test data for the computation of the educational quotients of the 
problem-pupil group were available for 48 of the 76 problem pupils 
reported in both surveys. The educational quotients for pupils 
reported in the April survey were computed from the Stanford 
Achievement Test. Those for the November survey were computed 
from the results of the Otis Classification Test. The average edu- 
cational quotient for all problem pupils is 107; for a sampling ot 
pupils in the entire school, approximately 117. We may conclude 
from these figures that the pupils reported as problems in the class 
room tend to have relatively both lower intelligence quotients and 


TABLE IV 


DisTRIBUTION OF THE STANFORD-BINET INTELLI- 
GENCE QUOTIENTS OF THE PUPILS Con- 
CERNED IN THE COMBINED SURVEYS 


Intelligence Elementary | High School Total 
Quotient School 
a 8K (2) (3) (4) 
70—- 79 2 2 
RO— 89 7 7 
90— 99 7 1 11 
100—109 13 5 | is 
110-119 ~ 6 14 
120-129 3 7 10 
130—139 5 5 10 
140-149 l 2 3 
150-159 
160—169 
educational quotients than pupils in the school, generally. The 


fact must not be overlooked that the bright child of good accomp 
lishment is frequently reported to be a problem The figure 
reported in this study indicate, however, that such pupils ar 
less frequently reported than pupils of less ability and pooret 
achievement 

he question may be raised, ‘‘ Were the children who were r¢ 
ported in the \pril survey also reported in November, provided the 
had remained in sehool?’’ Of the thirty-four children reported iv 
\pril, eleven, or about one-third of the group were also reported 


in November. All of these pupils had changed classes and wert 


“wl 





awe 


iF 
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eing taught, for the most part, by a new set of teachers. In a few 
ses in the high school, the pupil was being taught in one or more 
subjects by the same teacher he had had the previous year. Of all 
ipils who were reported on both surveys by the same or different 
teachers, the following facts were discovered: one child was re 
rted to be a problem by seven persons; two children were re 


orted tO be problems by three persons ; and eight children were 


ore d as problems by two persons. 
Individuals varied greatly in the number of pupils they re 
fed as pre blems The frequencies of cases reported by differs nt 


dua S follow ~ 


Puy 

Persor Repe 
at rt by Ea 
Lap é O0KGNwewadeneents 10 

Leas. pense stedesesacn nen 7 

£ +46 e600 dineee ee ceess } 

Sec. beck duiucnne aor a 


This variation in the number of pupils reported by different 
duals may be due to a number of factors. It is possible that 
persons reporting the larger numbers of problems are better 
to detect problem pupils, are more interested in the survey, 
nore willing to admit that they have problem pupils, or actually 
en to come in contact with larger numbers of problem pupils 
\ summary of the types of problems reported in the November 
vey was pre pared from the statements made by the persons re 
ng. The writer classified the problems in a way that seemed 
and consistent. The types of problems and the 


eh type found are listed in Table V 


Cases 


Deficiencies in the various schoo] subjects, poor study habits, 
{1 general mental immaturity are much more frequently men 


d as reasons for reporting pupils as problems in the high se! 


00 

n the elementary school In the elementary school, the un 
f nervous, shy, emotionally peeuliar child is reported as a 
niem more frequently than in the high school. The bad| 


11) 
1. dey lent. irre wil child is al e ¢ in tl 
ed, dependent, irresponsibie enhild aisO more common im the 


elementary sehool than in the high school. The other types of 


QO) 


problems show about the same percents of tTrequeney in each type 
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How can we explain the difference in ty 


he elementary school and high 


TABLE \V 


? b N y 
SoHOK 
N be I t 
; a 
9g 19.1 
) 7 14.8 
r 
tl e- 
nal 
13 27 .t 
y i 
badly 
ee 
10) i 
lems 
| ad- 
a » 7 
ndi- 
2 '.2 
7 


shorter pei 
nd he is possibly COTLCE 


Hinee 


the elementary 
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A SURVEY OF PROBLEM PUPILS 
s e opportunity to observe a pupil’s total behavior than has the 
rh-school teacher, she likely puts more emphasis upon the be 
: of the child. We must conclude that the difference in types 
4 oblems reported in the elementary and high schools is due 
to the facet that high-school teachers have less opportunity to 
serve nervousness, instability and erratic behavior, bad habits, 


the like; or that they consider such traits less important prob 

n the pupils’ deficiencies in school work and poor mentality 
treatment suggested by the persons reporting the cases was 
f supple mented by recommendations made by the psychologist 

ve careful study to all the material. These recommenda 
were given to the principals of the high-school and elem« ntary 
departments. In many eases the only recommendation pos 


was that further information must be obtained about the ease. 


( the probl ms reporte ad ean be regard d as serious clinical] 
ly 1 1eW CaASeS the problem was complicated. or the nature 
us yf the difficulty were obscure. Some of the problems 


idv well understood and needed little further diagnosis. 
e of the eases, the prognosis seemed hopeless. Learning 
ty cannot usually be increased, and it is frequently impossible 
ge the attitudes of parents and home environment. Some of 


pils needed a twenty-four hour remedial program which 


1 
’ > | 


it be provided in most eases. 


\ few general suggestions for further diagnostic and remedial 
vrew out ot the experi ner vained in this survey 


‘iany more tacts than were availabl should have heen recorded 


1 of these pupils. Most of the pupils should be ob 


erved by competent, unprejudiced persons from time to time 
the observations should be recorded in writing. A program 


the activities of the child during the average dav from the 
ng hour to bedtime would hy he pful In some cases 


Parents should he asked to come for conferences at which the 


ld’s difficulties are discussed. The homes of problem pupils 

ild be visited when this measure seems necessary and is 
tieabl 

( ‘al study is necessary in the more serious cases of malad 

stment. Such study should bring together all available data 


is to the child’s heredity, family history, developmental history, 
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home background, school record, present physical condition 
mental and educational status, parents’ and teachers’ reports 
of the child’s behavior, and the child’s own story of his diffi 
culties, if he recognizes them. Recommendations for treatment 
should follow an analysis of the difficulty. 

1. In some eases, the reclassification of the pupil within the seho 
appears to be the solution of the problem. In the other mor 
extreme cases, the parents should be advised to transfer the chil: 
to a different institution. 

5. All pupils who appear to suffer primarily from physical d 
turbances should have more thorough medical examination 
Neurological examinations will be necessary in several cas¢ 
The advice of nutrition experts should be sought in others 


Kew of these problems will disappear in a day. Many will per 


sist for months. It may be a comparatively simple matter to detect 
t he difficulty and tO recommend the proper correctional procedure 
but it is quite another matter to re-educate a child who has persisted 


n bad habits and attitudes for a period of years. In many cases 


iT even more difficult to secure assistance trom adults whose { 
operation is nee ary if a el ild’s hehaviol IS TO he altered. B li 
t is obviously unfair to give up any problem pupil as hopeless 
before a thorough analysis of the situation has been made at 


remedial measures have been undertaken 

We may not hope that progressive educational methods w 
reduce the incidence of problem pupils in the school population 
With the greater refinement of our tools for observation and wit 
a growing fund of information furnished by genetic studies « 
school children. the most hopeful prospect is that problem eases 
nay be detected more readily than is possible at present, that 


remed 


al and corrective measures may be employed in the incipient 


‘ 


stages of the difficulty, and that such treatment may become more 


scientific. 





ea? Toe 








NEW THINGS THAT ARE REALLY OLD 


Wituis L. UHL 
University of Wisconsin 

BeroreE the maximum service of any movement can be economic 
rendered, a critical evaluation of what has already been done 
other persons is often necessary. When this principle of pro 
re is applied to any educational activity, as curriculum-making, 
sent-day educators are driven to an examination of methods ot 
eulum construction in the past. Such canvass can be of great 
fit if it reveals persistent problems and suggestions for their 
solution 
Of the numerous problems which have persisted for centuries, 
modern curricular problems which are really old are here 
; ( nted These problems will be Suga sted ior two purposes : 
to emphasize the prevalence of persistent problems in educa 
and, seeond, to set up challenges for ourselves. That is, an 
‘ational problem which has defied scholars for centuries is th 
rhtful property of the Research Association. Furthermore, our 
temporary outsiders may properly expect scientifie educators to 
nee beyond early scholars who had to depend upon intuition 
lempirieal data. This challenge will be accepted only when these 
ems are successfully attacked and the nature of the advances 

interpreted to our challengers. 
| The opposition to new learning.—The resistance of the 
ses to the findings of scientists was particularly fatal during 
e Athenian Age, for it is recorded that upon two occasions, gen 


ons apart, a disregard for ‘‘modern’’ science | d to the destrue 


' armies of Greeks. Upon one of those occasions, an army of 
ty thousand soldiers was halted in their plans for a prudent 
retreat by an eclipse of the moon. The difficulty was not that they 


re unable to find their way during the eclipse, but they were 
rned by their prophets that the eclipse indicated the wrath of 
ana and that a month of quiet was obligatory as a penance. As 
enemy’s prophets were not disturbed in the same way by the 
eclipse, all the Greeks were either massacred or sold into slavery 


seems also that the Greek prophets, as ministrants of morals, 
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patriotism, and soundness of faith, had, shortly before that time, 
exiled an enlightened general, and that they had otherwise dis 
regarded the teachings of Anaxagoras about the causes of eclipses 
Opposition to science in this matter persisted, however, so that th 
l‘hebans, over one hundred and fifty years later, similarly suffered 
defeat for their bigotry. The Greeks finally met this situation sue 
cessfully by educating their lawmakers in science and tolerance.’ 
During the twelfth century Adelard of Bath complained not 
only of his generation’s inborn prejudice against new ideas, but he 


} 


ilso satirized the prevailing reliance upon past authorities and 


gave a remedy for that defect. It is difficult, he complained to his 
ne nhew to discuss certain topies ot biology He continued : 
I earned from mv Arabian masters under the leading of reason; 


yever, captivated by the appearance of authority, follow your halter. Sine 


ld authority be called than a halter? For just as brutes art 


From those worshippers of authority, Adelard distinguishe 
himself, and added: 


If want to hear anything more from me, give and take reason. F 


l’m not tl sort of man that can be fed on a picture of a beefsteak.2 


The new literary learning at the dawn of modern times encour 
tered difficulties similar to those of scienes Petrarch, for example, 
vas compelled to defend the elassical learning against two groups 

enemies. One of these groups was composed of persons who, lik 
many mediaeval scholars, feared contamination with the ev 
thoughts which the classies subtly hear. The other group wa 
of persons who had already been demoralized by the 
heathenish teachings of Virgil. After giving the members of th 
second group a permanent and forcible dismissal from his home, hi 
et his own position clear in a letter to Boeeaccio. There he pre 
tested that he knew of no one who had been ‘*nrevented by literature 


from following the path of holiness 


Cf. John Burnet, Early Greek Philosophy. London, A. and C. Black Cor 
p. 271, for a translation of the Greel urces on this point. 
8 d History of Magi 
Erpe tal Science. Macmillan Company, 192 Vol. LI, pp. 28-29. 


Translated in J. H. Robinson and H. W. Rolfe, Petrarch: the First 
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Lawmakers, priests, and the ignorant masses are not, however, 


only opponents of new learning. It seems that any man who 


ves the beaten path of purified folkways is liable to disaster. As 


example, Dr. William Harvey may be cited. Harvey was a 


cessful practitioner and, up to a certain date, was highly re 


ected by the members of his profession. Meanwhile, he conducted 


rches and even frequented the university halls. He discovered 


t current notions of the human circulatory system were erroneous 


set up in their place the results of his discovery. Thereupon, 
members of the medical profession discovered that he ‘‘was 


1 


brained,’’ and they all turned against him.‘ 
One of the best and most fundamental discussions of the attitude 
rd new learning is that of Aquinas. Although he discussed the 
blem with reference to Christianity, his procedure has equal 
with regard to heresy in other departments of thought. He 
sed that the study of philosophy and science be not merel; 
lered innocuous, but that instead it be pursued wheresoever facts 


d. He eontended that theology and natural science were 


rgely distinet, and that theologians should not attempt to settle 








yphieal or theological problems of which they knew little, for 
stians who deny as contrary to their faith the philosophical 
ns of problems which are really indifferent so far as the 
th is concerned, simply bring Christianity, in Aquinas’ opinion 
disrepute among the wise men of the world.”’ 
Syste matr criti son of ¢ urrr ular pra foces The S\ stematic 
lism of curricular practices is no new adventure. A _ briet 
ew of. this branch of educational literature will indicate the 


lity of many present-day criticisms of schools. Early in the 


endid day s of both Greece and Rome. erities deplored the vanish 


ication of bygone golden ages. Later, during the Athenian 


od, Isoerates eontrasted the superficiality of the short unit 


Scholar and Man of Letters New York, G. P. Putnam’s Sens, 1914 
See also R. C. Jebb in The Cambridge Modern History. New York, 
lan Company, 1907. p. 538 
“Aubrey, John. Lives of Eminent Men London, Longman, Hurst, Rees 
d Brown, 1813. Vol. II, Part II, pp. 376-86. 
Cf. Thorndike, op. cit., pp. 600ff. for a more complete discussion and 
refe 


rences. 
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courses of the Sophists with the scholarship of his own broad, 
liberal courses.® 

Plato also indulged in criticism in his comments on literature 
and music. His analysis of the materials of reading showed him 
as modern analyses of literature show modern educators, that many 


f the time-honored writings of the prophets are unwholesome for 
the moral and religious training of the young. Somewhat later 
Tacitus criticized severely the practices of his times, which not only 
permitted parents to set base examples for their children, but also 
to shirk their own responsibilities by substituting school training 
for home training. 

Mediaeval scholars had similar difficulties with their schools 
[hey were annoyed by both charlatans and pedants. The long 
winded pedants analyzed their subjects and magnified their ele 
ments until, according to Roger Bacon, a pupil had to give years 
of unnecessary time to extracting the essentials of such a subject 
as geometry. Indeed, Bacon could, so he said, teach more useful! 
geometry in a fortnight than the other friars did in ten or twenty) 
vears. Another educator, slightly later than Bacon, relieved thi 
crowded curriculum by reconstructing the course in science so that 
one might learn from his little treatise not only the gist of ‘‘in 


ble works and huge tomes,’’ but also many important points 


numera 
which pedantie authors had omitted." In reconstructing their cur 
ricula, mediaevalists had also to contend with the demand for prae 
tical courses. It was the belief of many teachers that boys could 
profitably economize their time by the shortening and enriching, o1 
even the omitting, of grammar. The economy thus effected enabled 
the boys to proceed more directly to the popular ‘‘modern’’ courses 
n commercial subjects. Chief of these new courses was corre 
spondence—the art of letter-writing came near over-shadowing the 
training in language and composition as then included in grammar 
Other practical modern subjects such as law and medicine wer 
opened to boys when the mechanics of reading were mastered. T 
make the situation worse for sound scholarship, the teachers of th 

*On the Sophists. Translated in R. C. Jebb’s Attte Orators. New York 


Macmillan and Company, 1876. 
pan) 


™ 


orndike, op. cit., Vol. II, pp. 630-49 are devoted to these points. 
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ractical subjects flagrantly advertised their powers and the 
reditable opportunities for rapid advancement in commercial occu- 
pations. The resulting decline of interest In grammar inspired a 
cholar to produce the educational treatise entitled The Battle of 
Seven Inberal Arts. In that battle grammar was humbled so 
it she withdrew into Egypt where she was born, thus leaving the 
| open for the knights of economy of time in education.* 

(jrammar did not, however, actually withdraw to Egypt, and 
r Italian humanists had breathed life into classical study, gram 
ir and the analysis of literature rose and again dominated the 
ilum of many schools. That form of stylistic degeneracy 
nown as Ciceronianism drew from Erasmus a satire entitled 
eronmanus, which ridiculed the endless verbalism of decadent 

imanism Rabelais, a contemporary of Erasmus, sought also 
rten the course in grammar by a satire which should have put 


end to pedantry. In this interesting account of the Li 


Deeds, and Sayings of Gargantua and His Sonne Pantaar 
belais recorded that Gargantua was carefully trained for ‘‘th 
rs, six months, and two weeks’’ in Latin grammar. Ther 
ter, he spent about nineteen years studying the comment of 
nts upon the classies, and then sixteen years and two months 
ng out ‘‘the age of the moon, the seasons of the vear, and th 
les of the S( i? and then his pree¢ ptor died ! \s the hoy , edu 
was still incomplete, ‘‘he got an old coughing fellow to teach 
till other ‘‘meally stuff’’ whereof he became exceeding wis 
ter, Gargantua forsook this old ‘‘muzzled dolt’’ nd went to 
‘rates who, after purging him thoroughly of all that he had 
dy learned, began a systematic, economical and benefici 


rse of study wherein he speedily mastered all the arts of h 


Many other early modern writers resorted 1O Satire Or to 


¢htforward criticism of curricular practices. One of the chiet 
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of these was Francis Bacon who restated in general terms nearly all 
the criticisms of learning that had already or have since been made 
\s examples of criticisms which have recently been effectively r 

peated there are Bacon’s assertions (1) that edueators are too 
prone to venerate uncritically either antiquity or novelty; (2) that 
educators assume that all possible opinions have been thoroughly 


tested and that only the best have prevailed; (3) that educators 





neglect to state clearly the objectives of education; and (4) that . 
educators are so provineial and complacent as to be led blind], 
by their enslaving devotion to certain subjects, so that they ean 
not even interpret objective evidence with due suspension o 
judgment 
Vives and Comenius, before and after Bacon's time respectivel) 
emphasized the importance of organizing instructional material t 
suit the individual capacities of learners. By classifying pupils {| 
according to no less than nine significant categories of individua 
differences, Vives set the problems which have engaged modern ex 
perts in mental testing and curriculum construction." By organiz 
ing and restating the laws of readiness and facility in learning 
(‘omenius |: id the psychological foundation ior his own reconstruc 
tion of curricula and for the reconstruction of each secondar) ' 
chool subject during the twentieth century.’ Daniel Defoe, wh 
had been trained in a nonconformist academy, was somewhat mor 
fiery and pointed in his attacks upon curricula. His analyses of | 
certain occupations in which he was interested convinced him not 
y that the curriculum of Latin grammar schools was useless, but — | 
oO that by its dullness, it operated as a selective device to dete 
mising lads from school j 
Numerous additional ecrities, as Socrates, Mareus Aurelin 
Ad rd of Bath, and Deseartes might also be mentioned. Enoug! 
Cases e, however, been cited to show that problems similar 
ose made during the twentieth century existed in earlier times 
nd that those problems evoked criticisms worthy of Huxley, Eliot 
or Flexn 
Tra issic of Knowledae cHAP. ITT See Foster Watson’ 
tion in Vives: On Education. Cambridge University Press, 1913. 
The Great Didact CHAP. XVII-XIX Translated by M. W. Keat 
ion, A. and C. Black, 1896. 
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.. Activity analyses as bases for objectives —Although activity 


Llyses have been conducted since Plato’s day for the purpose ot 
liscovering what should be taught, the recent use of the term 
tivity analysis’’ has led certain conservatives to oppose such 
wedures as both novel and narrow. Great differences exist, how 
among the forms of activity analysis. Plato, for example, 
yzed in the Republic with considerable care the activities of a 
ety which never existed. Consequently, Plato’s objectives lacked 


ose relationship to actual performances and conditions that is 


ssessed by later formulations. 
Erasmus derived a system of objectives by analyzing organized 
es in an enlightened community. He found that social effi 
y and academic proficiency were inseparable in the religious, 
stic, civic, and vocational lives of the persons whom he exam 
churchmen, landed proprietors, and diplomats. His findings 
him to conelude that certain desirable characteristics appar- 


the young. As the indi- 


n ssitated the formal training o 

s about whom he showed most educational concern were of 

ort whom Plato expected to develop into ‘philosophe rs,’’ the 
Erasmus would have serious limitations in an age of uni 


| 


education. A superficial survey of a state or a community 
the present-day point of view would have yielded numerous 
such as training for every one who was engaged in the 
rous activities which Erasmus quite overlooked. 
\ contemporary of Erasmus, Castiglione, also derived the ob 
ves of education from his observation and analysis of activities 
he was so untortunate, however, as to overlook almost the 
e world by confining his analysis to the activities of court life, 
work also has little general application in a democracy. These 
eases of activity analysis are cited as examples of the antiquity 
rtain aspects of this procedure. Their partial failure to pro 
le adequate bases for objectives can be attributed in part to their 
ricted scope and in part to their undemocratic philosophy 
t The enrichment of courses The enrichment of courses by 
ul teachers, a topic which forms the basis for many modern 
issions, was not neglected by ereat teachers of the pust As 
examples, teachers of the Athenian, Roman, mediaeval, and early 


modern periods will be cited Isoerates mentions and Quintilian 
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describes in detail this procedure. Alcuin attempted to enrich and 
enliven the mediaeval curriculum by the introduction of humorous 
pleasantries into his discussions with pupils."* The results of 
mediaeval curricular enrichment are shown impressively also in the 
accounts of Roger Bacon’s famous teache rs. Robert Grosseteste. This 
great educator taught young Bacon the use of languages as well as 
their constructions, thus impressing upon Bacon the fact that a 
knowledge of languages was the first gateway to the sciences.* It 
was this scholar who, besides knowing the languages and sciences, 
nspired Bacon’s own life of experimental research. In the earl) 
modern period, Vittorino enriched by word and deed his curriculum 
of physical edueation, literature, science, and socml studies.*° The 
effects of enrichment of courses upon pupils and society at large is 
well illustrated also by a line of teachers beginning in the seven 
teenth century with Theophilus Gale. This man developed, in his 
pupil, Thomas Rowe, a keen desire for sound scholarship such as 
ean still be traced in Gale’s The Court of the Gentiles. Rowe, in 
turn, transmitted his zeal for breadth of scholarship to his famous 
pupil Isaae Watts, whose work, entitled The Improvement of the 
Vind, was one of the elements of enrichment in academies for se\ 
eral generations. Watts, who was also a teacher, was generous in 
his praise of the ‘‘director of’’ his ‘‘ youthful studies’’ and, in a 
poem, ‘‘To the much honored Thomas Rowe,’’ extolled his master’s 
freedom from the trummels of tradition. The extensive value ot 
this line of great teachers can be inferred from Samuel Johnson’s 
essay. on Watts in his Lives of the Poets where Johnson asserted 
that few books had given him greater pleasure than that of Watts 
nd that Watts ‘‘taught the Dissenters to court attention by th 
races of language.’ 
(‘he frequency with which great men are inspired by teacher 


enrichment is suggested by these cases. Valuable enrichment has 


Mombert, J. I { History of Charles the Great. New York, D. Appleton 


Company, 1888, p. 247. 
‘RB n, Roger Opus Terttwm (Brewer’s edition), CHAP. 10 and 28 
Als st ‘*Der Einfluss des Robert Grosseteste auf die Wissenschaftliche 
htur les Roger Bacon’’ in Roger Bacon Essays, collected and edited b' 
G. Litth Oxford, Clarendon Press, 1914 


Woodward, W H. Vittorino da Feltre and Cth Humanist Educato ¢ 
Cambridge University Press, 1897. pp. 66ff. 
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t, however, always followed a desire to show pupils the possi 
bilities of the course of study. At the hands of teachers who have 
forgotten their own childhood, dessication and pedantry instead of 
enrichment seem to have resulted from ambitious attempts to show 


e ramifications of subject-matter. 


The relation of research to old practices.—A diagnostic study 
historical cases suggests numerous opportunities tor developing 
illianee between research and the history of education. Such 
illiance would probably lead to the complete discarding of many 

itgrown practices and to the alteration of others. As a conclusion 

this paper, some of the reasons for the failure or the suecess of 

he four types of old practices here presented will be stated as prin 
es of educational research. 

First, the persistent opposition of many human beings to new 

ng is probably due in part to the shortcomings of the advocates 

w learning. These advocates have often failed because they 


rlected to interest other persons in the problem or to state the 


em clearly to them. The public, like children, must eithe1 
cine need or the solution ot a problem Ol he enticed into new 
s of learning. The failures of the past can be attributed also 
art to three additional defects in the methods of advancing 
ce; namely, the inability or the unwillingness to share knowl 
e with fellow-workers or the masses, the inability to utilize 


? 


ective data, and the failure to show positive, convincing examples 
nfluential conservatives. 
Second, valid criticisms of curricular practices have often been 
nheeded because of remediable difficulties. Crities of superficial 
rses have failed because they lacked objective data which might 
supported their own cases. Mediaeval and early modern erities 
re unable to fortify their criticisms by experimental teaching or 
other method ot obtaining objective evidences An allied diffi 
was their inability to engage the support of well-trained 
chers. Crities also have often been unsympathetic with their 
ellow-workers and have thus neglected their strongest potential 
es. In the eases in which criticism has been most successful in 
inging practices, one or more of four conditions have been 


resent (1) there has been effective publicity of the problem and 
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its solution; (2) there has been clear evidence of its advantages: 
(3) there has been due consideration of the attitudes of the persons 
who received the criticism; or, (4) there has been a body of trained 
workers and other facilities for effecting a reform. 

Third, activity analysis is sufficiently venerable to command 
respect. Its failures seem to have been due to three causes: th¢ 
narrow scope of the analysis; the inadequacy of the proposed 
subject-matter; and the inadequacy of the educational philosophy 
which has underlain it. 

Fourth, the enrichment of courses has illustrations in every im- 


f history. It now seems clear that one of the most 


portant era < 
important reasons why such enrichment has been intermittent is 
that teaching procedures have in the past received too little atten 
tion: good teachers have developed rather by chanee than by 
definite training, and, hence, there have been few of them. The 
effects which would have followed a general provision of an excellent 
course in education, such, for example, as Vittorino received, can 
only be inferred. There was, at any rate, little knowledge of how 
or why to enrich courses. There was an almost total lack 0 objec 
tive educational data, and there was no adequate means of dis 
seminating even the best principles of teaching. 

An age of research should go beyond the ages of intuition. The 
present-day should, however, sift the intuitions of the past and 
demonstrate the values of the best. For this task the present age 
of research has many advantages over earlier periods: it has bette 
resources for analysis, better measures of individual differences o 
pupils, better weapons against superstition, better resources for en 
richment of subjects, and better criteria for reconstructing subject 
matter and educative activities. Furthermore, there is now it 
general a tolerance of criticism, and there is slight educational 
defense of dessicated courses. Research is challenged to accept th 
responsibility of discovering the best in history and philosophy, o 
demonstrating under known conditions the superiority of the best 


and of cooperating in the training of teachers to practice in the pri 


fession ot fe aching 
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FINDING MISTAKES VERSUS CORRECT ASSOCIATIONS 
IN SIMPLE NUMBER-LEARNING 
} GarRRY C. MYERS 
AND 


CAROLINE E,. MYERS 
Cleveland, Ohio 


\N ATTEMPT will be made in this report to answer the question, 
Is it more profitable to find mistakes or to re¢ peat correct associa 
ns The problem becomes more explicit when expressed in 
1e such form as, ‘‘ Is it better to observe that 8 X 7 = 54 is wrong, 
ippears among several other number combinations which 

rrect, or to think to one’s self, 8 X 7 06 7’’ 
an effort to answer this question, 564 elementary-school chil 
were tested individually. Half of them were given the task ot 
mistakes in a list of twenty simple number combinations ; 
other half were set to saying over to themselves these same 
combinations with their correct answers. From the alpha 
etical list of the names of the children enrolled in each class chosen 
this study, the members of each group were chosen alternately 
half might be exercised with the page of correct associations 


study with correct answers; and the other half practiced on 


First, the experimenter ascertained whether the pupil was 
familiar with the four arithmetical signs. If he made an 

i or in such discrimination, he was given practice until he had 
mastered the task. No child who in this preliminary 

de more than one mistake was used in th study. Every 


i was first given a sheet with these problems: 


Ss =4 8 2 7 15 8 
5 5 7 1 8 1+ 13 
: 1] 2 10 6 15 } 
' i > ; 9 j Qo 5 8 9 
0 + ) 17 5 i 7 13 6 

\s the pupil answered verbally, the experimenter recorded the an 


yer and kept the time 
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The pupil belonging to the Error-Finding Group was then given 


an exercise which was comprised of the following combinations: 


7X 3=21 9x 5 = 45 5— 3=>18 9X 4=23 
4+. §= 18 8— 2= 6 § + 24 = 32 100 — ‘6 { 
ll— 3= 9 2— 5= 7 6+ 5=l1 w— S= 
4+13=—17 3X 8= 24 2+ 7= 9 13— 6= 171 


The experimenter said: ‘‘Here the same problems, in a different 
Some of the answers are right and some ar 


Do not do an 


order, are answered. 
Draw a circle around each wrong answer. 
After the pupil had finished h 


wrong. 
thing with the other answers.’’ 
was given the same test which he had had at the outset. 

The pupil of the Correct-Association Group was given as his 
second task a sheet on which all the answers were right. To hin 
was said: ‘‘ Here the same problems, in a different order, are ai 
swered correctly. Afte 
he had finished he was given the same test which he had taken 
By this method the children of both groups were give: 
before and after the training exercise. The onl 
for one group it was to fin 


Say each one with its answer to yourself.’’ 


the outset. 
the same test 
variable was this intervening task: 
mistakes; for the other it was to read silently the combinations 
with their correct answers. 

If then the two groups were evenly matched on initial perform 
anee, whatever difference there was between the final performance 
of the two groups must have been a measure of the difference of t! 
degree of learning due to the intervening exercise. As we shall se 
later, these two groups received on the average, almost equal p: 
cents as measures of time and accuracy in the initial performanc 
From the records of 276 fourth- and fifth-grade children, one-hal! 
of whom had received each type of intervening training, 100 pairs 
were matched on the basis of the time taken for the initial perférn 
The time of each pupil in a pair was within two seconds « 
The difference be 


ance 
that required by the other member of the pair. 
tween the gain in the final performance of these two groups shoul 
be a measure of the relative value of the two intervening exercises 


" 
Of course, one would expect some practice gain if there hi 


been no intervening learning exercise; that is, if the test exercist 


One hundred forty-seven chi 


had heen given twice in succession. 
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the fourth and fifth grades were so practiced. Of these, 


ipils were matehed with 100 from the Correct-Association 
» on the basis of the time taken to do the initial test; and 100 
ateched with 100 pupils from the Error-Finding Group. 
rally, using this basis, the same hundred pupils of the 147 
matehed with each group. The results of these compar! 


ressed aS pe reents Ot gain wert 


Time Errors 
Required Made 
( Percent Percent) 
When 138 pairs were chosen 
ernately : 
Correct-Association Group... ... y yA 50 
Error-Finding Group ... ......... 1] 33 
hen 100 pairs were matched by 
time of initial performance: 
Correct-Association Group... .... 21 53 
Error-Finding Group... ......... 11 4 
When 100 pu] ils were matched with 
100 pupils having only successive 
pr tice: 
rrect-Association Group . Gime 21 48 
Successive Practice LETOUP. we cccces 1s 2S 
Error-Finding Grou] - ame 10 
Successive Practice Gri IPwcccccees 1S 27 


nrst place, the percentage gain expressed as reduction in 
ind errors for the 138 pairs chosen alphabetically is almost 
the same as for the 100 pairs which were selected by match 

tne time requ red for initial pertormance 
(he gain by the pupils who read the 20 combinations with theit 
answers once was noticeably vreater than the gain by those 
were set to find the 5 errors. For the Correct-Associatio 


he gain in time on the final performance was only slightly 


ter—not significant perhaps—than by the Successive Practices 
it the reduction in errors was noticeable—48 percent against 
ercent. However, those who found mistakes made less gain in 
d more in errors than those with successive practice, although 
differences may be too small to be significant 
may be coneluded that one reading of these twenty combina 
their answers contributes more to learning than no such 
iw and that it contributes much more than the search for the 
stakes among the 15 correct answers. On the other hand, 


sno evidence that anything is gained by the finding of errors 
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Instead, there seems to be an appreciable loss. These data are 
significant when one considers that the exercise is brief and that 
only one intervening exercise was done. 

Similar results were obtained when comparisons were mad 
51 pairs of V-A 
pupils we found that the gain in time on the final test over the 


within each grade and half-grade. Comparing 


initial test for the Correct-Association Group was 22 percent 
against 13 percent by the Error-Finding Group. The gain in 


accuracy or the decrease in errors was 53 percent against 25 pe 


TABLE I 


AVERAGE TIME AND ERRORS 
Time tn Seconps ERRORS 
| 
Learning 
Initial | Learning Final Exercise Initial Final 
Per- Exercise Per and Final Per- Per 
formance formance Per- formance | formance 
formance 
2 4) (5) (6 7 
Correct-association group 101 64 79 143 2.9 l 
Error-finding group 100 O4 SY 83 2.9 1.9 


eent. For the 32 pairs of V-B pupils the respective reduction in 
time for each group was 20 percent against 8 percent; in errors 
For 38 pairs of IV-A pupils th 
34 . 
wv il 


The record for 17 pairs of IV-B pupils was 28 percent 


55 percent against 38 pereent. 


} 


contrasted » . 


percents were 19 against 10 in time; 42 against 
errors 
against 9 percent in time; 54 percent against 38 percent in errors 
For eight still smaller groups, we found the same relative supe 

ority, without exception, for the correct-association method. 

For further evidence of the superiority of the correct-associatior 
method, let us compare the number of pupils gaining in time and 
accuracy in the final performance over the initial performanc 
Five of the 100 pupils who were given the correct-association exe! 
cise took more time on the last performance than on the first, whi 
thirty-two of the 100 given the error-finding exercise took mo! 
time. The respective figures for errors were 6 and 13. 

The time taken by the average pupil on the initial performance: 


on the final performance, on the exercise with correct answers b: 

















ne 
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the correct-association method, and on the exercise at finding errors 
are given in Table I. These figures were for the members of 138 
pairs alternately chosen. 

Here we see that the two groups made, on the average, the same 
number of errors—about 3 out of 20—and took practically the same 
amount of time on the initial performance, while on the final per- 
formance the time and errors greatly decreased. But the Error- 
Finding Group took about 50 pereent more time in the learning 
exercise—in their exercise of finding errors—than the Correct- 
Association Group took to say once to themselves the twenty com 
binations with their answers. Since they used more time in this 
learning exercise, they should be expected to do better in the final 
ormanee than the other group. But they did considerably 


' 
Wworne 


Suppose the time of the learning exercise and of the final per- 

rmance is compared as a measure of the difference in the efficiency 

the two methods. Here we find that it takes the Error-Finding 
(iroup a total of 183 seconds to reduce their errors from 2.9 to 1.9 
nd the Correct-Association Group only 143 seconds to reduce their 

rs from 2.9 to 1.5. 

Some one may suggest, however, that the difference in time be 
tween the two learning exercises may be attributable to the time 

juired in drawing cireles around the 5 wrong answers. After 
hese had been checked for them, the average time required by the 
(0 children studied was only 5.9 seconds. 

The following 20 addition combinations were used with 144 

rs of third-, fourth-, and fifth-grade children after the procedure 


ised with the 138 pairs already studied. 


54 7 84 6 8 415 6+4= 
7) 1] 15 4 16 + 3 24+ 7 
a 13 6 7 9 R > J 6 
S+ 7 13 8 {4+ 6 oa 1 

10 2 8 5+ 7 gS. § 


he number of errors on the learning page used by the Error 


Finding Group was 10, instead of 5, as in the other study. The 
rage time and errors are given in Table II. 
Here we find the same strong evidence of superiority of the 


Correct-Association Group. The initial time of performance for the 
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two groups was the same, whereas the Error-Finding Group mad 
fewer errors on the first trial. But after this group spent 117 
seconds on the learning exercise, they did not improve their fina 
accuracy one bit. Indeed, they just wasted 206 seconds, or about 
three and one-half minutes, by this exercise. The other grou; 
gained in its final performance 17 percent in time over its initia 
performance and the Error-Finding Group gained only 6 percent 
The respective gains in accuracy were 22 percent and 0 percent 
TABLE II 
AVERAGE TIME AND ERRORS OF 144 Pairs OF THIRD-, FOURTH-, 
AND FirTH-GRADE PUPILS 
Time IN Seconps ERRORS 


Learning 


Initial , eneminn Final Exercise Initial | Final 
Per- : - Per and Final Per- Per- 
P Exercise . . 
ormancs formance Per- formance | formance 
formance 
1) 2 3 i 5 6 (7) 
Correct associa- 
tion group 95 59 79 138 2.4 1.9 
Error-finding 
group 95 117 R89 206 1.9 | 1.9 


The records of these smaller groups given in Table III show 
without exception the same principles which we found when a 
these groups were merged into the 144 pairs. The differences so 
arrived at are real differences, as also were those of the earlier part 
of this study. To the lay reader, at least, the tendency of the data 
gained from a larger group to conform so consistently with the 
tendency of the data of the several component groups has a mor 
concrete meaning than a probable error. Obviously, the computa 
tion of a probable error in this study would be superfluous. 

In both these studies the data have no doubt failed to tell the 
whole story of the superiority of the correct-associations method 
There was no assurance that the pupil always went through th 
entire performance of adding such a combination as 8 + 24= 32 
when he said it to himself. There was some evidence that the pupil 
exercised on the correct associations attempted to remember th 


answers by rote and by position. In fact, the average child has i) 


school about as much practice in finding errors as in making correct 
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§ associations. This fact may have made the measured superiority of 
the correct-association method less than it really is. All the more 
certain it is then that the method of teaching such combinations as 
have been here considered by having the learner check mistakes is 
a wasteful method. 


TABLE IT 
ToTAL TIME AND Errors FoR Eacu Group By GRADES 


Novum- Timer ERRORS 
BER 
OF 
ReE- . 
-- First Per- | Last Per- | First Per- | Last Per- 
| PAIRS ; 
formance formance formance formance 
p 4 4 f 
ade V-B 
Correct Association Group vee 38 2,300 1,902 67 19 
Error-Finding Group... : 38 2,358 2,211 92 44 
le IV-B 
( rrect Association Group .. 53 | 6,134 5.072 149 111 
Error-Finding Group | 53 5.833 5.477 105 110 
III-A 
rrect Assoc ation Group ‘ 27 29 416 2.070 ms 19 
ror-Finding Group , 27 2,464 2,422 
IlI-B 
Correct Associat Group 2 Qe 2 370 7) ) 
Error-Finding Grouy ) 139 2.722 7 


To find mistakes some one else has made, however, seems to be 
a much more interesting exercise, in spite of its demonstrated in 
feriority, than the study of correct associations. This study neither 
nswers the question, ‘‘Is it wasteful to find and correct mistakes 
in more complex problems like that of a store bill?’’ nor does it 
throw conclusive light upon the efficiency of checking as a means of 


teaching number work. 








INTERFERENCE BETWEEN RELATED MENTAL 
PROCESSES 
L. W. CoLe 
University of Colorado, Boulder, Colorado 

CuRIOUSLY enough in the discussion of transfer of training on¢ 
point seems to have been agreed upon by all parties to the con 
troversy, namely, that there is transfer of identical elements. In 
early experiments the identical element was an ‘‘idea’’' common 
to both the practice series and the test series, or the identical el 
ment consisted of ‘‘sensations, images, movements.’ Later by 
identical elements were meant ‘‘mental processes which have thi 
same cell action in the brain as their physical correlates.’"* Suet! 
an identical element is probably not accessible to experimental! 
investigation. 

From the outset of the discussion, however, it has been claimed 
that, ‘‘improvement in addition will alter one’s ability in multipli 
eation because addition is absolutely identical with a part of mul 
tiplieation and because certain other processes—for example, ey¢ 
movements and the inhibition of all save arithmetical impulses 
are in part common to the two functions.’” 

This view is expanded by Gates into a theory of transfer,® and 
since the identical elements of addition and multiplication, subtrac 
tion and division seem to be objective, this claim has gone far 
toward the belief that the study of the environment and reactions 
to it may well replace the study of the mind—-one form of current 
behaviorism 

Professor Poffenberger tested the assumption that practice in 
addition transfers to multiplieation, and that in subtraction there 


transfer to division because of the partial identity of the processes 


Thorndike, E. L. Psychology. New York, A. G. Seiler Company, 19 


. Tbhid, p 164. 
Thorndike, FE. L. Educational Psychology Briefer Course. New York, 
Teachers College, Columbia University, 1925. p. 269. 


- 


* Thid.., pp. 268-69 
"Gates. A. I. Psychology for Students of Education. New York, Ma 
nillan Company, 1924. p. 366ff. 
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Instead of improvement in multiplication due to practice in addi- 
tion, interference was found; the unpracticed group made a better 
record on the final test than the practiced group. Between addi- 
tion and subtraction there was found to be neither transfer nor 
interference, apparently indicating absolute independence of the 
two processes. This is exactly the opposite of our results as will 
be seen from the tables which are given later.‘ 

In the investigation here reported we set out to test the effect 
of practice in addition upon addition, subtraction, multiplication, 
and division, and likewise the effect of practice in subtraction on 
the other three arithmetical processes. Since the two groups were 
practiced in different processes, it was believed that one group 
would serve as a control upon the other. 

In the first series of experiments four persons were practiced in 
addition and four in subtraction after a preliminary test in the 
fundamental operations. ‘After this period of practice a final cest 
in the four operations was given to each group. The practice con 
sisted of five periods of forty minutes each. The group worked for 
ten minutes followed by two minutes of rest. The following thirty 
minute period was divided by similar two-minute intervals. Prac 
tice was given on alternate evenings except that Thanksgiving recess 
ntervened which separated the last two practice periods by four 


lays. Preliminary and final tests of addition, subtraction, multipli 


cation, and division were each twenty minutes in length and ar 
ranged as in the practice series. 

Because four persons seemed too few to yield reliable results, 
we next repeated the experiment with eighteen others, nine to b 
practiced in addition and nine in subtraction. Some of these sub 
jects were Sophomores in college who were studying mathematics, 
and an equal number was assigned to each practice group. The 
results with nine persons did not materially change the results 
obtained with the earlier group. 

Instead of finding, as did Poffenberger, that addition and sub 


traction are independent functions, we found them closely related. 


***The Influence of Improvemé nt in One Simple Mental Process upon 
Other Re lated Processes,’ > Journal of Educational Psychology, 6:470-7 +, Octo 
ber, 1915. 
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We found interference, however, between some of the processes. 
This seemed important. Although much better known in physio 
logical studies than in psychological, interference must have de- 
stroyed completely the reliability of the results of thousands of 
experiments whose duration was not more than two or three min- 
utes. Interference has been recognized in giving fore-exercises in 
psychological tests; but it has been named confusion, embarrass- 
ment, or nervousness. The recognition of the fact that interference: 
may occur with no emotional accompaniment seems important. Thx 
mere incorporation of a simpler process in a more complex one may 
destroy all effect of practice in the former for a considerable time 
Thus the simplicity or complexity of two processes may be far mors 
important than the amount of objective identity between them 
This fact, well known to introspection, is important in the arrangs 
ment of textbooks and in methods of instruction. 

Sinee the results obtained with the smaller group, Group A 
were fully confirmed by the experiments with the larger group, 
Group B, and by the tests of Group C, which will be mentioned 
later, the results for the first two groups are combined in Table | 
The total number tested was twenty-six 

What appeared to be an enormous gain in the aeecuracy of addi 
tion due to two hundred minutes of practice, namely, 145 percent 
was found, yet Brown’ reported a gain of 253 percent by one person 
due to only one hundred minutes of drill in the fundamental opera 
tions of arithmetic. There was an actual loss in both accuracy 
and speed of multiplication by those practiced in addition. By; 
Poffenberger’s interpretation, who took into account only the tim 
gained in stating his results, our records for addition and multipli 
cation would indicate that bonds must be broken in turning from 
addition to multiplication. I believe, on the contrary, that a mor 
complex process interfered with a simpler one when addition was 
incorporated as a part of multiplication. There was probably no 
antagonism beyond this between multiplication and addition. 

The group practiced in addition gained 3.0 percent in accuracy 


in subtraction and 6.6 pereent in time. The subtraction group 


***An Investigation on the Value of Drill Work in the Fundamental 
Operations of Arithmetic,’’ Journal of Educational Psychology, 3:492, 1912. 
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rained 23.0 pereent in accuracy 1n addition and 16.7 percent in 


speed in that process. These amounts were large ¢ nough to anne; 


i 
ndicative of a positive relation between addition and subtraction 
If one acted as subject for such experiments—as the writer did 

the explanation was simple. One found himself familiar with 
many combinations in addition which h immediately applied to 
subtraction. Having added 9 and & repeatedly he immediately 
noted that 17 — 9 8, or 17-8 9; and the reeognition was in 


tantaneous. In fact, the important result of our experiment 


TABLE |] 


AVERAGE INpIVIDUAL GAINs oR Losses, Groups A AND B 


ACCURACY 

PROBLEMS 

CoRRECT PROBLEMS I'rw 

ATTEMPTE! M 
Number | I N | N | 
on Group 
Gain in addition >. 1 145.0 , 39 
Gain in subtraction 1.8 3.0 6 8 ze 6.6 
Loss in multiplication 2.6 5.2 9 1.4 
Gain in division 0 0 { 
Subtraction Group 

(ain in subtraction | 6.0 10.4 RQ 1 { 928 0 
Gain in addition 8 23 0 1.8 16. 7 
Gain in multiplicatior ; 7 { 7 
‘ hi in division i) 0) 4 > 1) 
emed to be its indication that objective dentitv had little to do 


with the results; subjectiv identity had everything to do witl 
them 

‘his is important because we are just now witnessing the com 

ete elimination of associati n by similarity as a factor in econom: 


earning or as a factor in productive thinking from textbooks on 


educational psychology. Yet it is the simil: ritv ol combinatior 
whi h CaUSES the improvement from ar tion to subtractior an 
nversely, if actual experi nee in the tests is any guide to an 


nterpretation of the results. 
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The group practiced in addition made no gain in aceuracy in 
division. This was in agreement with the theory of identical ele 
ments if we ignored carrying. But neither did the group practiced 
in subtraction gain in accuracy in division, and such gain the 
theory of identical (objective) elements does demand. There was 
the same gain in speed of division by those practiced in addition as 
by the subtraction group. 

Poffenberger concludes, ‘‘Where there are no identical bonds 
between stimulus and response in the two processes, the influence 
of one test upon another will be neither positive or negative, namely 
there will be neither transference nor interference,’’ and this h 
found between ‘‘addition-subtraction’’ and ‘‘addition-division.’ 
We have found addition and subtraction to be positively related, 
addition and division to be independent as far as accuracy is con 
and these facts are supported by the independence ol 
to accuracy. But division is 


eerne ad : 
division and subtraction in respect 
positively related in speed, and by the same amount, to both addi 


tion and subtraction. This amount is slight and may doubtless be 


accounted for by the fact that both groups practiced computation 
Professor Poffenberger’s experiment differed from ours because his 
subjects added or subtracted the same number, namely 17, to 


series of fifty numbers in the ease of addition and from a series ot 
In multiplication 


twenty-five numbers in the ease of subtraction. 
the multiplier was 7. Addition and multiplication were found to b 
negatively related or to suffer interference by Poffenberger, as ir 


our own results. Since there is objective identity between addition 


and multiplication and between subtraction and division, the proba 


bility is that incorporating one process into the other causes inte? 


ference and completely, or partly, overcomes any influence of ol 


jective identity. 

By actually counting every single combination of addition, sub 
traction, and the like, in all these problems we were able to arrive 
at a score combined of speed and accuracy somewhat similar to the 
scholarship score used at Columbia University for correlating in 


telligence with scholarship. 
may be summarized in Table Ii by stating the averages alone i 
we recall that thirteen persons were practiced in addition and thi! 


teen in subtraction. 


The results make a long table which 








oe le. 
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‘here was about half as much gain in division by those prac 
ticeed in subtraction, as by those practiced in addition Yet 32 


percent of the efforts in division were subtractions. Only 14 per 


cent were additions, if we assume that carrying tens, are additions 
the students report that they did carry. 
There was a marked improvement in the processes practiced, but, 
14 


; ; 
aul 


here weighted, this was somewhat less in subtraction than a 


} 


lit { } 
1d1110n tO sub 


tion. There appears to be a spread of effect from a 
etion. Only three of thirteen persons practiced in addition 
led to improve in subtraction, and only two practiced in sub 


ction failed to improve in addition 


AVERAGE INDIVIDUAL Scores, Groups A anp B 
SPEED AND ACCURACY COMBINED 


Prelir ary Fina 
Tes Test 
1) 2 
Addition Grou 
Addition 3.0 78.0 
Subtraction 122 .¢ 126.7 
M Itipli ition US 0) of O 
Division 91.0 93.0 
Subtraction Gr p 
Addition 3.0 5? 0 
Subtraction 118.0 133.0 
Multiplication 91.0 91.0 
Division 87.0 SS.0 


As weighted, there is a loss in the final scores in multiplication 
bv those practiced in addition and no loss by thos practiced in sub 
traction. Subtraction seems to have improved division one point, 
but this is negatived complet ly by the fact that addition improved 
division still more. 

By assuming that adding, subtracting, multiplving, or dividing 

single digit by another constituted one mental effort, we counted 
the mental efforts in these problems as accurately as possible. In 
nly one average did the amount of improvement correspond with 
the theory of identical elements. This was entirely due to one 


person who made a very low record on the preliminary test. 
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It is sometimes stated that there should be as much improve- 
ment in multiplication, due to addition, as there is addition of 
partial products in multiplication. This seems to be a hasty as- 
sumption, and it was never fulfilled. A more reasonable assump- 
tion is that if 40 percent of a given multiplication test consists of 
additions, one who has improved 20 percent in addition should 
therefore improve 8 percent in the multiplication. We found this 
proportion illustrated just onee. This was between subtraction and 
division problems. In our experiments mental processes seem to 
have been helped not at all by objective, partial identity and in no 
instanee to the extent that the theory demands. Where the theory 


TABLE III 


AVERAGE INpIVipuAL GAIrNs or Losses, Group 
C, SPEED AND AccURACY COMBINED 


— = 
Gain or Loss| Percent of 
i | ble s | Gain or Loss 
l 2 (J 
Addition 0 0 
Subtraction 1.5 6.8 
Multiplication 1.5 loss 7.1 loss 
Division t loss 3.0 loss 


demands improvement it was not only absent, but there was an 
ctual loss over the preliminary efficiency. 

Finally, in order to make more certain of our results, we 
assembled a year later twenty-three persons, eight of whom prac 
ticed addition, seven practiced subtraction, and eight took the pré 
liminary and final tests but did not practice at all. The first two 
groups confirmed our previous results fully. Only the third, un 
practiced control group, gave a different record and that perhaps 
was exactly what might be expected. The results which appear in 
lable [II indicate that we were measuring the effects of the prac 
tice given in the experiments. 

Since the experiments with larger groups confirmed fully those 
with the original small group, it seems evident that more reliable 
results may be obtained with two small carefully equalized groups 


tT? 


an with a random selection of hundreds of subjects on the 
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assumption that chance alone will equalize all differences. On 
Woodworth’s theory, that we enjoy doing what we possess a special 
talent for, the prevalent experimentation on hundreds of subjects or 
reagents is due probably to a desire to treat the records statistically, 


rather than to a proved efficacy of the method. 


CONCLUSIONS 

EL 2 by identical elements is meant objectively identical elements 
our results give no evidence that transfer is so limited 

». Subjective identity of combinations in addition and subtraction 
was realized as a help by all who took the practice. This gives 
little support to the claim that introspection is the least reliable 
method of psychology.‘ 

3. If Gates’ theory of transfer is to hold true, identity must be 
defined in each instance and by terms less vague than identity 
of ‘‘attitudes,’’ ‘‘methods,’’ and ‘‘movements.”’ 

+. If our results give little evidence that objective and subjective 
identity are in practice the same thing, they give still less for the 
widespread assumption that motor learning—habit formation 
and intellectual learning follow the same laws. It seems to 
have been overlooked that learning to send and receive tele 


graphically proceeds at quite different rates. 


>. The full agreement of results from two larger groups with 


those obtained from a carefully divided smaller group gives little 
support to the assumption that random selection of many sub 
jeets will equalize or ‘‘ecanecel’’ all individual differences, both 
temporary and permanent. 


jenson, C, E., Lough, J. E., Skinner, C. E., and West, P. \ Psychology 














AN ASSOCIATION STUDY OF THE VOCABULARY 
OF GRADE CHILDREN 


C,. G. SHAMBAUGH 
AND 
OLIVE L. SHAMBAUGH 
Stanford Unwersity 


WHILE numerous studies have been made concerning spelling 
and vocabulary in general, some phases of the subjects have re- 
mained uncultivated, and other phases are in need of re-working 
from a more practical point of view. Vocabulary for adults has 
received considerable attention, and some valuable work has been 
done in the field of the chikl’s vocabulary. Most investigations 
however, have been influenced by the needs of the adult rather 
than by the immediate, daily needs of the ordinary child. Beeause 
of this fact, the so-called established ‘‘children’s vocabularies’’ 
show a disparity of 40 or 50 percent. As far as the writers hav: 
been able to ascertain, no one has given proper weighting to thoss 
words which the average elementary child uses in his daily life 
and which may not appear in school compositions or children’s 
literature. On the suggestion of Dr. John C. Almack, of Stanford 
University, the writers have endeavored to investigate this aspect of 
the vocabulary problem. 

The most extensive piece of research in vocabularies is Thorn- 
dike’s monumental work in which he endeavors to establish the ten 
thousand most frequently used words in the English language.’ 
Although his work has had a great influence and has stimulated 
other pieces of research, it may not be an adequate criterion for 
selecting words for elementary pupils, for, as Gates has pointed 
out, 86 percent of the material considered in the study was used by 


adults.? 


‘Thorndike, E. L. The Teachers Word Book. New York, Teachers Col 
lege, Columbia University, 1921. 134 pp. 

*Gates, Arthur I. ‘‘The Construction of a Reading Vocabulary for the 
Primary Grades,’’ Teachers College Record, 27: 625-42, March, 1926. 
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A recent and valuable work in the field of spelling is Horn’s 
list of ten thousand words most commonly used in writing.’ Since 
most of his sourees deal with adults’ vocabularies and his expressed 
aim is to determine the words most frequently used in the writing 
done outside the school, we may legitimately question whether his 
list is an adequate criterion for selecting the vocabulary most valu 
able to elementary-school pupils.* If one expects to meet the needs 
of the student, should not the present needs of the student be con 
sidered as well as the field of written English outside the school? 

Breed has realized the necessity of considering the vocabulary 
from the child’s point of view and has stated that vocabularies 
based on various types of written discourse are not satisfactory, 
since much of their material is not justified on the basis of social 
need.° His vocabulary list, however, consists of a composite of 
eleven adults’ lists and five lists gathered from children’s themes, 
with a majority of his words chosen from the adult sources. 

Perhaps the most valuable study made on the basis of free asso 
ciation is that recently completed by Doleh under the guidance of 


€ 


Dr. Buckingham, of Ohio State University. The aim of Dolch’s 


study was to discover those words which constitute the vocabulary 
of most children in Grades III to VIII, inclusive. This investiga- 
tion is of great value because the words are taken entirely from 
the vocabulary of the pupil. However, since it is based on free 
association without any stimulus word to direct, the writers believe 
that a need exists for a further study that will call for associations 
n a wide field of the child’s experience. 

The aim of this study has been a threefold one. The first aim 
was to discover those words that hold the most important place in 
the daily voeabulary of the child of elementary-school age. The 

*Horn, Ernest. A Basic Writing Vocabulary: Ten Thousand Words Most 
Common!y Used in Writing. Iowa City, Iowa, University of Iowa, 1926. 226 
pp. (University of Iowa Monographs in Education, First Series, No. 4 

* Ibid., p. 3. 

* Breed, Frederick 8S. ‘‘What Words Should Children Be Taught to 
Spell?’’ Elementary School Journal, 26:118-31, 202-14, 292 306, October, No 
ember, December, 1925. 

*Doleh, Edward William. ‘‘Grade Vocabularies,’’ Journal of Educational 
Kesearch, 16:16-26, June, 1927. 
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importance of these words was judged on the basis of richness of 
association. The second purpose was to examine these words as to 
their expression of fundamental necessities in the life of the child; 
and the third, to compare these words with words selected by other 
methods. It is evident, then, that the task has been to find those 


words that have been overlooked or undervalued in other studies. 


TABLE I 


NuMBER OF DIFFERENT WorpbDs IN Eacu GRADE 
with THEIR FREQUENCIES AND NUMBER 
ComMMON TO ALL GRADES 


| Number of Total 
Different Frequency 
Words 
ee ~ (2) (3) 

Grade IV : 2,102 32,905 
Grade V | 2,108 42,389 
Grade VI 2,827 52,845 
Grade VII | 3,017 55,987 
Grade VIII 2,612 46 505 

| 

| 

: 


Total | 230,631 
Number common to | 


all grades 


| 
Rate see, Rte coll 





METHOD USED 

The association method was used in this study, since it promised 

to be the most effective technique in discovering those words which 
are important in the daily life of the elementary-school pupils. The 
stimulus words were not taken from any established word list; the 
writers thought it best to be guided entirely in their selection by 
the elementary child and his environment. The four hundred 
stimulus words used in this study were therefore selected according 
to the following criteria: (1) words that come vividly into the daily 
home life of the child; (2) those that touch a large number of 
phases of the childhood experience; (3) those that pertain to ex- 
periences fundamental in the development of man; and (4) those 


that include name words, action words, and modifiers. 
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The 400 stimulus words as finally chosen included 316 nouns, 
These 


The nature of the words is shown by the 


67 verbs, and 17 modifying words. were arranged in eight 
lists of 50 words each. 
following 50 words which comprise one of the eight lists presented 


to the students: 


iunkle dressing hurry necktie seem 
ar! feed infant open seold 
| find knob perfume spoon 
ket fork kitty plants spider 
fight lard pink soap 
stmas gingham listen play stick 

ly growl milk quit thimble 
y handkerchief machine rug towel 

el ist hide metal see valentine 
op hook marbles salty write 

In order to show better the range of the stimulus words, the fol 


wing list of 35 words is given which contains a sampling of five 


rds from each of the remaining seven lists of stimulus words: 
chicken 


vacation newspaper 


ra gas 
ror rubber clock flower sleep 
armer table music load calf 
skate alfalfa match pencil glass 
violin library tele] hone fence letter 
r money whistle grass magazine 
rty rent auto happy run 


The eight lists were submitted to fifty students in each of 


Grades IV to VIII, inclusive, who were selected from eleven ele 


mentary schools in California and Oregon. The tests were given 


so that no one group of students responded to more than one list 


f stimulus words. This arrangement, it was expected, would give 


s a total of four hundred students responding to the eight lists in 


} 


each grade, or two thousand students responding from all five 


Since, however, some of the schools failed to return all the 


grades. 


number of children whose papers were checked 


lists, the actual 
mounted to only 1.851. 


Each list of 50 words was mimeographed on a sheet of papet 
with 25 words on each side. Aft 


‘ter each stimulus word, space was 


t for the student to write in four or five words which he asso 


ted most closely with the stimulus word. The group method was 


itilized in submitting the se tests to the students. It was made 


clear that this was not a spelling test. 
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After the tests were returned from the various schools, all re- 
This tabulation showed a 
total list of all words arranged in alphabetical order, the total fre- 
quency of each word appearing in any or all of the grades studied, 


sponse words were carefully tabulated. 


and the number and frequency of all words appearing in each 


orade, 


SUMMARY OF FINDINGS 


The data in Table I show that 4,515 different words appeared 
in a tabulation of a total frequency of 230,631 words. The most 
significant fact, however, is the 1,309 words that are common to al! 
the grades. The fourth-grade pupils responded with 2,102 different 
words; and 1,309, or 62 percent of that number, appeared in al! 
the higher grades. This indicates that the majority of the fourth 
grade words are fundamentgl to the experience and life of the ele 
mentary-school pupil since they are retained in all the grades. 

Words of high frequency.—Perhaps the most important section 
of any vocabulary is that composed of words of high frequency 
For purposes of comparison and analysis, all words in this stud) 
with a frequency of five hundred or more were segregated, which 
The following 


groups are composed of those 98 words; the 25 words of highest 


resulted in a list of 98 words of high frequency. 
frequency are in the first group and the remaining 73, in the 
second group. The lists illustrate the type of words revealed in 
this study as most meaningful in the life of the elementary-schoo! 
child. 


Group I 


eat dress boy clothes stove 
man food girl cow baby 
wood house fruit milk cook 
water good bed flower cake 
tree eloth fire meat table 
Group Il 
chicken cold dish dog play chair 
pretty warm work candy cat hand 
horse paper red sweet wash wear 
white apple bread color cut face 
green hurt picture shoe sleep smoke 
thread woman black book clean coat 
dinner floor glass grass hair hot 


' 


ee eee 




















STUDY OF VOCABULARY OF GRADE CHILDREN 45 





iron lady light money mother music 

noise people pie run sick stocking 
tter can car cry dirt door 

og hat head knife leg letter 
inge potatoes school sew smell sugar 


egetables 


The 98 words may be classified as follows: 


Frequency 


Categories Number 
et Ka Gal aan wien ae 21 
Home and family............ 18 
Se Gig. a Caeekenneemeuens 10 
BS. 4» Shescctnaewersanedn 8 
D0 + aetsebewen anon x © 
PU dd 6 Cannensedsebereut 7 
SS aN? ath Gla Bue eo ar a Gro 6 
EE 4a gane ak one ae 5 
IED ld‘. ° thine eee eae 4 
it <5 6 oie ana waa ey oe, 
P+ 6s aseeheninasnnen 3 
Miscellaneous . .. ...cscecees 6 


This classification clearly shows that the words of high frequency 
are those which concern the more basic and fundamental experiences 

the human race. The growing child thinks in terms of food, 
family, clothing, and the body which are essential for his existence. 
While these words are important in the child’s life, they may not 
be of high frequency in the adult reading and writing vocabulary. 

Only sixty-one of the ninety-eight words of high frequency in 
this study are found in Thorndike’s first 500 words, fifteen of the 
words do not appear in his first 1,000, and 3,000 words in his 
irrangement are required in order to cover the first ninety-eight 
words in this study. The fifteen high-frequency words not found 


n Thorndike’s first 1,000 are: 


stove chicken dish candy cat 
read pie stocking dirt knife 
range potatoes sew smell vegetables 


(he absence of the words just listed is all the more interesting since 
lhorndike’s first 1.000 do inelude such words as account, arrive, 
rown, moment, organ, power, re maim, repatr, seize, settle, units, 
d value. 

The high-frequency words compiled in this study increase in 


gnificance when these ninety-eight words are compared with the 








. 
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first 3,000 in Horn’s word list. Such a comparison appears in t] 


following table: 


Number 
Horn’s Frequens of 

Group Words 
a.) Fee sone ae 
A re ee 22 
a eS 
Dn sé < « hewedautie Gees 10 
NE <n weateneme bakin 9 
DE oo Wieunteaainedacdea 7 
Ps Ge SES céeebeeiraaeane i) 


As this table shows, eighty-nine of the ninety-eight words of hig! 
frequency in this study are quite evenly distributed over the first 
3,000 words of Horn’s list, while nine of the words are not ineluded 
in Horn’s first 3,000. 

The nine words become more meaningful when contrasted with 
some of the words which Horn does include, as is shown in the 


al 


following lists: 


Worps APPEARING IN THE HORN LIST 


First 1,000 Seeond 1,000 Third 1.000 
point death frame 
material relation silence 
factory honor lumber 
copy liberty apartment 
board branch battle 
order cotton gun 
time banquet silly 


Worps Not INCLUDED IN THE HORN LIST 


apple hat thread 
dish knife smell 
dirt stocking vegetables 


Of these twenty-one words, taken from Horn’s first 3,000 words 
seven were found in his first 1,000, seven in the second 1,000, and 
seven in his third 1,000. Although these words were not carefull) 
selected, they clearly show the fundamental difference between th 
Horn list and the words compiled in this study. Horn gives 

much heavier weighting to the word point than to the word dish 
or hat Even words such as death, liberty, banquet, silence, a1 

silly are more important than apple, knife, stocking, and vegetables 
Horn’s first and fourth highest words are time and order, while 
the first and fourth highest frequency words in this study are eat 


and water. The first two words are of a more abstract nature and 
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y a more prominent part in adult life, while the latter two words 


pia 


are more concrete and vital in a child’s life. 


Words common to the five grade 8. The analy sis of the words 
tabulated in this study may be continued by giving attention to 
the 1,309 words which have a frequency of seven or more and 
which appear in each of the grades. The fact that these 1,309 
words have a frequency of seven or more and are common to all 
erades is adequate proof that they should be given a prominent place 
n the vocabulary of elementary-school children. 

When this group is compared with the first 3,000 words in 
Horn’s tabulation, one finds that 665 words, or 51 percent, of the 
1,309 words common to all grades are not included in Horn’s first 
}000. This disparity, of course, arises from the fact that Horn’s 
list was taken largely from adult sourees. <A elassifiecation of these 
1,309 words into categories yields an order similar to that of th 
group having the highest frequency. The categories arranged in 
order of popularity are food, home and family, nature, clothing, 
body, behavior, animals, recreation, machinery, people, school, 
marked 


and 


eolor The results ot this study therefore seem To show E 
difference between the words of richest association in the daily life 
the pupil and the standard word lists compiled from adult 


sources. 





PREVALENT ERRORS IN NEW-TYPE EXAMINATIONS 


D. A. WORCESTER 
University of Nebraska 


THE SUCCESSFUL use of standardized tests in elementary and 
secondary education and the apparent ease with which questions 
in objective form are devised and scored has led many to adopt 
these tests for informal quizzes and examinations. Frequently, 
however, the person making up such an examination is not schooled 
in the technique of test-building. For that reason he is led by the 
seeming simplicity of the method into framing questions which do 
not meet the intended purpose. In fact, it must be confessed that 
some of the so-called standard tests for courses in education hav 
not been subjected to that rigorous item-by-item standardizing 
process which has characterized most of the best tests for el 
mentary- and secondary-school subjects, and they have, therefore, 
failed to show the results expected. 

Various treatises have set forth some of the principles of test 
construction, and Wood has called particular attention to certai 
subtle difficulties which may appear in common test forms.’ It is 
the purpose of this article to eall further attention to pitfalls whic! 
threaten the security of objective-test results. Instances where thi 
pitfalls were not escaped will be shown. The ease with which sucl 
examples may be found warrants posting a few warning signs. 

A matching test is usually thought to be a good one, particular! 
if the list from which matching items are to be chosen contains mort 
items than there are things to be matched. The chances for erro! 
in such a test, however, are not so great as they appear to be. Fo 
example, a certain test of history-civies vocabulary gives 25 exer 
cises to be matched from a list of 50 words. At the first glance it 
would seem that there are forty-nine chances for error. One exer 
cise reads, however: ‘‘The large cotton farms in the South are 


GQ ixvecarnn ’* Obviously the completion word must be plu 


Wood, Ben D. ‘‘Studies of Achievement Tests, II,’’ Journal of Educa 
tsonal Psychology, February, 1926. 17:125-39. 
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knows the meaning of evolutionary will hardly choose the wrong one. 





June, 1928 | ERRORS IN NEW TYPE EXAMINATIONS 49 


in number, and examination of the list of 50 words reveals but two 
plurals, plantations and reservations, so the chances of error are 
reduced from forty-nine to one. Another test—a standard test for 
a college course in secondary education—gives a list of 34 words, 
15 of which are to be used to complete sentences. One sentence 
reads, ‘‘The power of the church as an ........ factor in Ameri 
ean life has diminished.’’ Clearly, the word to be chosen inust 
be an adjective and must commence with a vowel sound. The stu- 
dent, to be sure, may not analyze the problem thus completely, 
but he will look for a word which will make the sentence ‘‘sound 
right,’’ and such a word must meet the deseribed conditions. Now, 
of the 34 words, but two meet the necessities. These are antago- 
stic and integrating, and one of them is palpably unsuitable. 

This same sort of error oceurs in a book explaining the con- 
struction and use of the new-type examination. A sample test in 
plane geometry is shown in which certain blanks in a paragraph 
are to be filled with words chosen from an accompanying list. Two 
sentences of the paragraph read, ‘‘An ........ is a portion of the 
circumference thus cut off. The part of a circle included between 
OD. cceese fea GEO dn:6.c 0000s ’* The words are 
arc, center, circle, circumference, curved, equally, line, plane, point, 
radu, secant, sector, segment, straight, tangent. There are only 
two words, arc and equally, which begin with a vowel and which 
will therefore sound right after an. As the sentence calls for a 
noun, equally is ruled out. In other words, only one word in the 


] 


list will complete grammatically two of tl 


e four blanks indicated 
"he second sentence obviously calls for a plural, and there is only 
one plural in the list, radu. Even if the pupil did not know radu 
to be plural, he would find it hard to discover in the list any other 
ord which would sound right. This, then, may be as much a test 

grammar as of plane geometry. 

In the standard test for a college course in secondary education 
which was mentioned previously the following sentence appears: 
The evolutionary character of social progress requires a constant 


of secondary edueation to the demands of society. ’? Here some 


+ 


action word is needed and the list of 50 words contains but two 


which ean possibly be used, readjustment and resistance. One who 
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Another exercise in this test very evidently begs the question. It 
is: ‘*The aims of secondary education are not mutually exclusive; 
instead they are ......... ’> One immediately sees that he must 
find an opposite to mutually exclusive and the list contains only one 
term which can even remotely fill the bill, supplementary. A similar 
begging of the question is found in the pure completion exercise: 
‘*Sinee people today do not work as many hours a day as formerly, 
the secondary school should provide the prospective adults training 
in the use of ......... ** Will any student of good intelligence who 
reads the first clause carefully fail to find a suitable word for the 
blank space? 

Multiple-choice questions are sometimes too easy for the student 
heeause the test-maker gives as possible choices things which never 
are chosen. For example, we find in an informal test: ‘‘The largest 
share of one’s daily work depends for its suecess on (the recall of 
previously learned reactions, the amount of money one has, one’s 
good looks).’’ A tabulation of sixty-two consecutive cases from 
the members of two classes, all of whom indicated the correct an 
swer, tends to confirm the suspicion that this exereise was not a 
test item at all—merely ‘‘busy work.’’ A three-choice test may be 
in effect reduced to a two-choice one by such a question as: ‘‘ Psy- 
chology, in constrast with sociology, has to deal with the behavior of 
(groups of people, the individual, neither).’’ Only through an acei 
dent would anyone mark neither. A choice which no one ever takes 
does not, of course, constitute a factor in a test. 

A flagrant case of giving the question away is found in a stand 
ard test which requires the student to check two chief causes of un 
successful teaching from a list of three—‘‘too many outside inter 
ests,’’ ‘‘disloyalty,’’ ‘‘ poor health.’’ Aside from the fact that the 
list probably does not mention the chief causes of unsuccessful 
teaching, it is interesting to note that whatever two causes are indi 
eated one of them must be right. Another exercise in the sam 
examination instructs the student to mark nine considerations which 
the public school must consider in constructing curricula. Since 
the list from which the nine are to be chosen contains only thirteen 
items, five of the nine will be correct, and the chances are even 
that two more will be. No way of scoring can make the test good 
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In these tests the bright student can sometimes discover and 
give what the instructor wants without putting any serious thought 
on the subject-matter involved. Recently the writer read a test on 
note-taking. The procedure of the test is to present a paragraph 
and then to submit five pairs of notes on the paragraph with the 
instruction that the best of each pair be checked. Six such exercises 
are given. The test seemed so easy that the writer tried the fol 
lowing experiment with a class of eighteen students. The first 
three exercises of the test were given in the regular way so the 
students clearly understood just what was wanted. In the other 
three exercises the paragraphs themselves were cut out of the test 
blanks, leaving only the pairs of notes. The students were then 
asked to pick out the best notes relating to absolutely unknown 
material. Half of the class was at least 80 per cent successful in 
identifying ‘‘best notes’’ on matter which had never been read 
This, of course, does not say that the test was not a measure ot 
something—possibly, even, of note-taking. What is evident is that 
it was not just the test its authors intended it to be 

The discussion thus far has concerned tests for which the stu 
dent may get eredit even though he does not, in reality, know the 
matter called for—tests, that is, which may more nearly measure 
ingenuity or intelligence than achievement. There is another type 


error as a result of which the student may fail to receive credit 


when he does know the answer. The cause for this error seems 
to be the ‘‘mental set’’ of the test-maker. In one form of the Army 
Alpha Test, as others have note d, one is expected to ma ‘‘same’’ 

opposite’’ to the pair of words cleave and cut Either of these 


of course, correct. In a test of biblical knowledge on 
correct term in the sentence, ‘* Testam t means a book, a eove 
nant, a will, a law.’’ The key says that covenant should be under 
ned, although the dictionary vives equal sanction to a ‘‘ will.’ ‘he 
tatement, ‘‘ There is an essential! .... of interest between the 
individual and society,’’ in a certain test requires completion with 
the word congruity. A student who selected the word opposition 
from the list offered might well argue for the correctness of his 
choice. Similarly, in an arithmetic vocabulary test of the matching 


on his note 


‘om pletion type, the accepted answers To ‘The 


s due in thirty days,’’ ‘‘A modern manufacturing concern cannot 
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be run without ........, ’? and ‘‘The company paid hima ....... 
of $4000 per year’’ are principal, capital, and salary, respectively 
They might as well be interest, profit, and dividend, all of which 
are in the list, but these latter words do not receive credit. 

In a test of ‘‘ religious ideals’’ full eredit for the question, ‘‘ How 
do you think of Jesus?’’ requires the answer, ‘‘ As the founder of 
the world’s greatest religion.’’ Tests in principles of education and 
similar subjects are apt to require similar dogmatic assent to propo- 
sitions having other possible and plausible answers. The same test 
on religious ideals, after specifically warning a person to tell just 
what he thinks, requires one to put a cross before the five best 
answers to the question: ‘‘What do you think happens after 
death?’’ Two of the answers are: ‘‘We do not surely know’’ and 
‘*The dead live only in the memory of those who live after them.’ 
If a person checks the second how can he answer any other, and 
if he checks the first, what is the use of indicating anything else? 
Yet, to receive credit, one must indicate the first answer and four 
more. These errors of ‘‘mental set’’ are particularly common but 
not peculiar to the completion type of question, and they involv 
dangers against which every test-maker should guard. 

The writer is in no way opposing the use of objective tests 
formal or informal, for their value has been amply demonstrated 
He is merely trying to point out that the construction of such tests 
is not so simple an affair as their appearance indicates and that 
unless the test-maker exerts great care the test may measure some 
thing quite different from that for which it was intended. Unless 
much attention is given to the number of items which might b 


chosen to complete a test, to grammatical construction, to the dis 


similarity of different parts of the test, and so on, and unless tl 
author of the test is able to free himself from ‘‘ mental set’’ so that 
bivalent statements are avoided or recognized as such, the new-typ 
examination will possess very little superiority over the old forms 
of examination. 

A rather interesting indoor sport, and one that almost invariabl; 
illustrates some of the points made in this paper, is taking an in 
formal test in one’s own subject which has been made up by some 


one else. It is quite as amusing—and a trifle safer—if the author 


of the test is unknown. 
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AN EVALUATION OF ITEMS TO OBSERVE IN 
CLASSROOM SUPERVISION 


A. 8S. BARR 
Department of Education, U nive rsity of Wisconsin 


One-hundred and six superintendents, supervisors and prin 
cipals at a recent meeting of school men assembled to discuss prob 
ems of classroom supervision made, at the writer’s request, a list 
of the specific items of teaching usually observed by them in class- 
room supervision. These lists were made upon the spur of the 
moment and are probably not as complete or as carefully stated as 
they might have been under more favorable conditions, but they 
nevertheless represent certain more or less interesting facts about 
the present status of classroom supervision. 

In the first place as one examines these materials, one is im- 
pressed by the lack of agreement among supervisors as to the 
important characteristics of teaching. These 106 supervisors sup 
plied 131 different items to observe, 72 of which were mentioned 
nly onee. It seems a bit as if each supervisor employed his own 
system of supervision. This matter is one of some importance since 
supervisors’ occupy positions of authority, hiring, Cismissing and 
variously advising teachers according to these private systems of 

ipervision. Are these various items important characteristics of 
good teaching? They seem like so many unvalidated test items, 
based upon the personal choices of the supervisors using them. A 


list of the twenty most frequently mentioned items is given below: 


WHAT SUPERVISORS LOOKED For IN CLASSROOM SUPERVISION 
Fre yuUCTH 

a. Pupeie” taterest im sebgect... occ ccccccccscces ore. 

2. Physical conditions im room.......ccccccccscccces 24 

p MABENOD GE PUNE 6 oc ccccccvnseseseess 18 
rere Ee eTCTTCriT yy oe 

ne a a ee ain aii einetene Sides 15 

C. TEE. GE WEED cc oc ccte cs cccadeessscses 15 
IS a i a ae 14 

8. General attitude of teacher and pupils.......... l 

9. Atmosphere of classroom... ...... 12 
10. Skill in teaching technique Pc ebseeveweuene 12 
11. Evidence of teacher preparatio l( 

‘The term supervisor is used here to include special supervisors, principals 


1 superintendents. 
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BR. BEOUNOG OE MGTGTUGRs occ ccdcccccvccscncecvetveus 9 
SSE 06 b. 0.c0bb0b.0005400s60cn00a0cbecweees 8 
14. General appearance of room............-seeeeeces 8 
15. Evidence of pupil preparation...............ee006: 7 
16. Ability of teacher to ‘‘ put across’’............006. 7 
17. Teacher and pupil codéperation................06.: 7 
BG. WER MOE Gin cn case cucsctbccvcccecovesessvsens 7 
19. Type of questions asked by teacher............. o G 
SO. TROGIEED 6 6c ccccosescsccensccoccesccescosooese 6 


A second characteristic of these items is their subjective char- 
acter. Expressions such as attitude of pupils, atmosphere of the 
classroom, spirit of codéperation, responsiveness of the class, teach- 
er’s sense of justice, and move of the recitation, regardless of their 
importance as proper constituents of teaching, are entirely too sub- 
jective to serve adequately the purposes of classroom supervision. 
No two supervisors, for example, would probably agree upon the 
amount of attitude possessed by a given class, or the amount of 
spirit, responsiveness or move. The observation of this fact and the 
one already noted above has suggested a number of questions. 

These questions may be stated as follows: (1) How valid are 
the items to observe which compose these various private systems 
of supervision? (2) How objective are they? (3) Can super- 
vision be made more objective? (4) If a new system of supervision 
is postulated, what evidence is there that it possesses superior 
validity? (5) What evidence is there that it possesses superior 
objectivity ?, and (6) What evidence is there that it possesses su 
perior reliability to the old? 

The materials to follow deal only with certain aspects of this 
wider problem of classroom supervision. In this sense the materials 
are fragmental and incomplete. What the writer really does is to 
set forth a certain theory of supervision with some evidence per- 
taining to its validity, reliability and objectivity. The data pre 
sented really do not constitute a solution to the problem presented. 
[t is hoped, however, that the materials offered may elarify the 
issue and suggest a method of attack upon it. The problem is one 
of considerable importance to those concerned with the constructive 
supervision of teachers in service. 

Theoretically, the subjective character of current items to ob- 
serve seems to be due to their inferential character. Such ex 
pressions as atmosphere of the classroom, spirit of coéperation, 
responsiveness of the class, and the like, seem to be mere inferences 
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drawn by supervisors from objective data observed by them, these 
data not being included in the expressions (or labels) used to 
characterize the teaching performance observed. The point can be 
illustrated by an intangible expression such as ‘‘move of the reci- 
tation.’’ A supervisor of my acquaintance was recently very much 
impressed with the move of a particular recitation. Now I do not 
know what ‘‘move of the recitation’’ meant to her, but it means 
to me the rate of teacher talk, plus the interval of wait between the 
teacher’s question and the pupil response, plus the rate of pupil 
talk, plus the interval of wait between the pupil’s response and the 
teacher’s comment measured against my notion of what consti- 
tutes a satisfactory standard of ‘‘move.’’ If one cares to analyze 
such expressions as these they can be reduced to lower terms which 
are more objective. The point may be further illustrated by the 
word, ‘‘sportsmanship.’’ Now sportsmanship is an inference based 
ipon observable activities. What the observer really does observe is 
the exchange of greetings by opposing captains, the slugging of one 
player by another, the assistance of an injured opponent to his 
feet, ete., from which he concludes that one group of players is 
more sportsmanlike than another. It would seem that if supervisors 
could be trained to observe and evaluate teaching in terms of spe- 
cific teacher and pupil activities that supervision might be made 
more objec tive. 

Several studies have been conducted to test the practicality of 
this hypothesis. It will be the purpose of this paper to give a pre 
liminary report upon these studies and indicate some of the prob- 
ems ahead in the development of scientific supervision. In general 

e point of view taken is that items to observe, regardless of 
whether they are printed in formally prepared lists of items to 
observe or whether they are informally applied out of the super- 
visor’s wealth of experience, must have validity, reliability and 
bjectivity. Let us turn our attention to this problem. 

The first study to be reported is a study of the validity of certain 
items to observe applicable to the supervision of the social studies.’ 
The first step in this study was the development of a list of more or 

* Barr, A. 8S. ‘‘A Study of the Teaching Performance of Good and Poor 


Teachers of the Social Studies in the Junior and Senior High School.’’ Forth 
coming—Bureau of Research Bulletin, University of Wisconsin, 1928 
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less typical teacher and pupil activities (an activities check list) 
This 


work was initiated by sending trained observers into the classroom 


following the theory of objectivity already set for the above. 


with instruction to list the specific teacher and pupil activities 
Two hundred fifty obser- 
These 
observers wrote down not what they thought about the teacher’s 
From these ob- 


observed by them during a class period. 
vations were made, each being for one full recitation period. 


work but what she and her pupils actually did. 
servations a preliminary list of teacher and pupil activities was 
compiled. This list was given a preliminary trial and further re- 
vised. The list as it was finally issued was composed of some thir- 
teen papers of specific teacher and pupil activities. Two samples 
from this list are given below. In order to save space and to 
illustrate the next point the data for these two sections of the 
activities check list are filled in. One section of the activities check 
list deals with the characteristic actions of the teacher; another 
with the kinds of questions that teachers ask. The items contained 
in these two tables are more or less typical of the thirteen pages 


which comprised the entire check list. 


TABLE I 
("HARACTERI c AcTIo } we TRACHEI 
NoumpBer Teacuers Disptayine Cuat 
ACTERISTIC IN SOME AMOUNT 
A Y 
47 good teachers 17 poor teac! 5 
1. Laugl 
) 
, l 7 
» Smiles (Uriend! ! tivel 2 2 
§. Fro ' ‘ 
4 Ges 24 19 
Nod ipil recit y 
| t pul i Ss 
rf 5 es fi d cdlis » 
8 Snane Snaer ttenti 
} Nod ioproval 24 i 
l Giggles l 
*Means t t r lected 


Having prepared an activities check list, the next step take 


was 10 stu ly the validitv of the various items contained in it. The 
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TABLE II 


Tue TEACHER’S QuESTIONS (KIND 


39 Goop Tracuers | 38 Poor TEacHERrs 


KIND 
Av. Freq. | St. Div. |Av.Freq.| St. Div 


(QJuestions of fact (e.g dates, peopl 


places, events, et 15.0 19.4 5.3 22.84 
Memorized judgments (e.g., comparisons 
ind contrasts, cause and effect. relatior 
hips, applications, impressions and 
inions, answers given in textbook 10.05 3.22 17.4 1.63 
Expository questions (meanings, explana- 
tions and illustrations) 1.84 rf +] t.1 
t_ Real judgments (e.g., comparisons and 
contrasts, cause and effect, relation- 
ships,applications,impressions and opin- 
ions, answers not given in the textbook 16.60 11.43 11.2 8.61 


reader will recall that an instrument of measurement is valid when 
t measures what it purports to measure. That is, in this case, 
each item must bear some definite positive or negative relationship 
to good teaching. There are several ways of testing this relation- 
ship. The relationship may be tested (a) by an analysis of expert 
opinion, (b) by studies of the activities of good and poor teachers, 
or (ce) by controlled experimentation. The second of these methods 
seemed best adapted to a preliminary survey such as the study here 
reported and was the one used. 

Forty-seven good teachers and forty-seven poor teachers were 
selected for study. The criterion of good and poor teaching was 
the judgment of three independent judges.* The study consisted 
of a careful comparison of the teaching performance of good and 
poor teachers upon the various items contained in the activities 
heck list. Both qualitative and quantitative differences were noted. 

In the two lists of items presented in Tables I and II there seem 

be no significant differences between good and poor teachers. The 


first table is illustrative of the materials treating of qualitative 

For a fuller statement of the basis for selecting good and poor teachers, 

see Barr, A. S., ‘*A Study of the Teaching Performance of Good and Poor 

Teachers of the Syeial Studies in the Junior and Senior High School.’’ Forth 
ming—Bureau .|f Research Bulletin, University of Wisconsin, 1928. 
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differences and the second table illustrative of the materials dealing 
with quantitative differences.* A qualitative difference, to be sig- 
nificant, must be some characteristic of teaching always present in 
one group of teachers and never present in the opposing group of 
teachers when an infinite variety of cases have been studied under 
conditions of perfect objectivity and reliability. No difference pre- 
sented in Table I seems to be of this character. A quantitative 
difference to be significant must be three times the standard error 
of the difference. No difference given in Table II seems to be of 
this order.’ Should all such items as those reported above prove to 
have little validity we should find ourselves in somewhat of a 
dilemma with items such as attitude of class, responsiveness of 
class, atmosphere of classroom, and the move of the recitation havy- 
ing no objectivity, (this statement is subject to statistical verifica- 
tion) and items such as the number of thought and fact questions 
asked by the teacher, the frequency of use of illustrative materials, 
and the time consumed by teacher and pupil having no validity. 
The problem is an interesting one. 

Two further studies* pertained to the objectivity of various 
items to observe. Two methods of studying objectivity were con- 
sidered: (a) The agreement of the observations of many observers 
using the same check list observing the same teacher teach; (b) the 
agreement of the observations of a relatively small number of ob- 
servers using the same check list but observing many different 
teachers teach. The first procedure gives a fairly accurate picture 
of what a number of observers will do when observing the work of 
a particular teacher; the second procedure gives a fairly accurate 
picture of what a particular few observers will do when observing 
the work of many teachers. Both procedures were followed; data 
from the second method are given below; only a few of the items 
are given. 

* Qualitative and quantitative are used here approximately as these terms 
are applied in chemistry. 

*The complete report does contain, however, some significant qualitative 
and quantitative differences. 

*Schoonover, A. F. ‘‘A Study of the Objectivity of a Teacher’s Check 
List.’’ A.B. Thesis, Department of Education, University of Wisconsin, 1927 

Midthun, M. A. ‘‘The Objectivity of An Activities Check List for the 


Study and Improvement of Teaching.’’ Master’s Thesis, Department of Edu 
cation, University of Wisconsin, 1928. 
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TABLE IIl 
KOEFFICIENTS OF CORRELATION BETWEEN THE OBSERVATIONS OF Two INDE- 
PENDENT OBSERVERS OBSERVING THE TEACHING OF A 
NUMBER OF DIFFERENT TEACHERS 
COEFFICIENTS OF CORRELATION 
ACTIVITY 
First Study* Second Study'* 

| her 8 use of tl word ‘‘all right Y2 44 
( ires 833 SS 
Repeats answers i] g? 
( 3 pupil's response 90 68 
teacher walks about 5S G4 
with class 70 56 
lackboard 55 SO 
Memorized judgments 54 SU 
vs up with more questions SU ov 
yn furniture 10 S4 
| tory questions 50 72 
Number of fact questions 13 7a 
Real judgments 35 71 
er smiles 34 15 

Discipline 78 

Assignment (character of 67 

t questions 10) 
S lies new information 9 05 
Subject matter humanized* 20 
Suggests methods of overcoming difficult i 17 
of pupil’s experi nces* 01 


*Based upon 25 observations 

>Based upon 105 observations 

The entire activities check list of thirteen pages was used in 

ese studies. The materials presented in Table III are merely 
] 
pi 


np 


es from the larger number of items studied. Each pair of 
bservers had one week of training. This training consisted pri 
rily of memorizing the check list, accustoming themselves to 
bulating the frequency of occurrence of various items, and in 
iking comparisons of the frequencies secured. In the subsequent 
ection of data the observers worked independently; that 1s, 
here were no day to day comparisons of data. The object of this 
idy was to determine the amount of agreement in the observations 
f two fairly well trained individuals working independently. 
While the two studies are by no means in perfect agreement 
ipon the objectiv ity of the various items studied they are sufficiently 
accord to indicate approximately the amount of agreement to 


under the conditions under which 
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these observations were made. The higher coefficients of correla 
tion, pursuant of the hypothesis previously proposed, are found i 
those data illustrative of specific teacher and pupil activities of th 
more detailed sort, and the lower correlations are found among 
general items such as use of pupil experiences, humanized subject 
matter, character of the assignment, ete. Unfortunately, for the 
larger study of objectivity, no items such as atmosphere of the 
classroom, attitude of the teacher, responsiveness of the class, mov 
of the recitation, ete., appeared in the list. A very interesting 
fact, beyond the low and high correlations already referred t 
brought out by these data is the varying degree of objectivity dis 
played by so-called objective items to observe. The agreement 

by no means perfect, even with such items as gestures, smiles 
laughs, walks, repeats answer, etc. It would seem thus that obje 


tivity depends upon (a) the definition of the thing to be observe: 


= na ateaiches Ste ate 


(b) the amount pf training of the observers, and (ce) and the num 


ber of items observed simultaneously. This last statement is, 


eee: 


course, subject to statistical verification. 
Two further studies’ were made of the reliability of differe: 
numbers of supervisory visits. The items of teaching observed b 


sola ae 


supervisors in their study of teaching need to have not only validit 


and objectivity but reliability. This problem is again one of con. @ 
siderable importance to supervisors. How many visits should . 
supervisor make in order to get a reliable index of teaching effi 
ciency? Or otherwise expressed, is the teacher’s performance re 
tively constant or is it variable? Many supervisors operate upo! 
the assumption that teaching performance is constant. To thes 
supervisors the data gathered in a short ten-minute visit are sufi 
ciently reliable to justify supervisory action. A sampling of the 
data is presented on the following page. 

The data presented in Table IV are based upon the frequencies 
secured from five consecutive visits to each of a number of teachers 
The average frequency of occurrence for each item for five visits 


for each teacher was first calculated. The data presented in Tabl 


'Sigurdson, Sigurd. ‘‘The Reliability of the Activities Check List 
the Study and Improvement of Teaching.’’ A.B. Thesis, University of Wis 
consin, 1927. 

Struck, L. A. ‘‘The Reliability of the Activities Check List.’’ M.A 
Thesis, University of Wisconsin, 1928. 
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TABLE IV 


Cue RELIABILITY OF SUPERVISORY VISITS 


ACTIVITY Mi M: AD; ADs, \ V: 





s from class 05 wh 2.0 1.29 1. o% 19 9 
+ responses +. O5 1.46 15.06 
te ' vere } 27 ri 48) 9 { 2 R23 70 2 17 Q¢ 
< tTatements ¢ 
1.95 +. 2 1.2o Ry 80.12 19 8 
snew formatior 51 7.58 5 2 if 129 Of 5 #9 
. 
‘ nur 
2.12 12.64 1.76 1.61 (103.77 : 8 
to class 1.09] 7.37] 1.04] 2.66 |119.26 | 45 
ANATORY STATEMENT As has already been pointed out the data in this table are taker 
two studies The subscripts indicate the study from which the data are taken, M: is the 
ge frequency for each item secured in the first study; Mz: is the average frequency f 
secured in the second study; AD; the aver le r the first study; AD» t ’ ag 
for the second study; V: the coefficien for the first study; V: tl efficic 


wr the second study 


re the mean performance for seventeen teachers reported in 
irst study and twenty-one teachers reported in the ss cond study. 
iverage deviations and the coefficients of variations wer 

ly ealeulated. The findings of the two studies are not par 


\ consistent. but one would seem w irranted however, in 


¢ the conclusion that teaching performances is not constant 


for example, the average and average deviation for, ‘*questions 


the class,’’ that is, questions asked by pupils. The average 
P . : 
ons are almost as large as the means themselves. Assuming 
these data are correct and sig? ifieant the variations are exceed 
cr} ; +4 ' : ‘ 4 ] ’ + +} ] } ry 
4 (other items in the iple suppol lis general obser 
} irthney? study. howeve} wil T oh; hy SNOW That eertain 
~ re eonstant and others vat hls Sipervisors w 1] need TO 


however. the reliability of the items used by them in their 


rvision. 


*Tt al 1 he rer her that ¢ ‘ ta resent variable « s hased 
two facts rs: a the ol wectivity f the items t observe * and I the 
lity of the teaching nerf rmanes na + n the latte al née 1s 


in this discussion. 
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The point of these various studies is that items to observ 
whether based upon formally prepared check lists or whether based 
upon the informal observations of supervisors, need to be tested fo: 
validity, reliability, and objectivity. The means by which valid 
reliable, and objective items to observe are to be secured is by 1 
means settled. Current items such as, atmosphere of the classroom 
spirit of coéperation, attitude of the teacher, responsiveness of the 
class, ete, are too subjective to serve adequately the purposes of 
classroom supervision; isolated teacher and pupil activities suc! 
as those studied in this investigation seem objective enough but 
possess little validity. Thus we are left in somewhat of a dilemma 
Of course new research upon the specific activities of teachers and 
pupils may indicate new activities of considerable validity. In th 
meantime the best guess about the procedure to be followed in the 
development of new items to observe would seem to be about as 
follows: (a) list first those facts, prineiples, and procedures known 
to be characteristic of good teaching. These may be derived from 
expert opinion, practice, or experimentation. (b) Translate eac! 
fact, principle, or procedure into specific teacher and pupil activi- 
ties. (c) Test the seale so derived for validity, reliability, and 
objectivity. 

The theory of developing valid, reliable, and objective items to 
observed set forth in this discussion has an interesting bearing upon 
the experimental study of teaching. The experimental study of 
teaching is frequently considered synonymous with objective super 
vision. But such ean hardly be the case. Some of the experimental! 
findings are sufficiently objective to serve the purposes of supe! 
vision and some are not. Freeman’s principles of method in teach 
ing handwriting given in the Eighteenth Yearbook of the National 
Society for the Study of Education (Part IT)® are, for exampl 
objective enough to be of immediate assistance: 


Rule 1. The writer should face the desk squarely. 

Rule 2. Both forearms should rest on the desk for approximately thre 
quarters of their length. 

Rule 3. The paper should be directly in front of the writer. 

Rule 5. The forearm should form a right angle with the base line of the 
letters. 


* Freeman, Frank N. ‘‘Principles of Method in Writing.’’ Eighteen 
Yearbook of the National Society for the Study of Education, Part II. Public 
School Publishing Company, Bloomington, Lllinois, 1919. 
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Rule 7. The hand should rest on the third and fourth fingers. not on the 


side, ete, 


Obviously the writer either is facing the desk squarely or he is 
not; both forearms either do rest on the desk for approximately 
three quarters of their length or they do not; the paper either is 
directly in front of the writer or it is not. That is, such materials 
are relatively objective. If the reader does not care to follow this 
line of reasoning the objectivity of the material can, of course, be 
tested statistically. 

Frequently the conclusions of experimental investigations are 
not so objectively stated. Let us suppose that we have experi- 
mentally determined that those materials which are humanized are 
most interesting or that functionally acquired subject matter is 
ongest retained. Such principles may have validity enough but 
0 objectivity when applied by teachers and supervisors to the im 
provement of teaching. The supervisor needs to know what con- 
stitutes a correct application of the principle. The supervisor may 
say: ‘‘Is the teacher being observed at this moment making a valid 
ipplication of the principle or is she not?’’ There is much leeway 
for example, in defining such terms as project method, socialized 
recitation, and individual instruction. The question is always 
present of which project method, which socialized recitation, and 
whieh individual instruction. Experimental studies, particularly 
f the comparative type, that fail to describe objectively the methods 
or devices compared are really of very little value to either teacher 
1 supervisors. As a matter of fact neither are they scientific. T¢ 
be scientific, the methods or devices compared must of course br 
objectively described. The notion of describing methods of teach 
ng in terms of specific teacher and pupil activities, qualitatively 
nd quantitatively, already set forth at some length above, seems 

us to supply a practical means of objectively describing the 
method or devices compared in the experimental study of teaching 

Similarly, principles of method must always be translated by; 
both supervisors and teachers into specific teacher and pupil activi- 
ties before they can be incorporated into new teaching procedures. 
This fact seems to have been overlooked by many experimentalists. 
The production of new principles of teaching, however, subjectively 


Stated, will, of course, constitute a distinct contribution to the im- 
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provement of teaching. But this experimental work might be more 


helpful to teachers and supervisors if experimenters would re. 


member to supply objective description of correct application of 


the principles experimentally derived by themselves. These data 
are all contained within the set up of the experiment itself. It 
eannot be otherwise if the experiment has any scientific status. 

A final problem to which attention should be given is the gen 
eral confusion of validity and objectivity in supervision. The 
fact that an item is objective does not indicate that it is valid 
The supervisor may, for example, count with considerable exactness 
the number of smiles, frowns and gestures made by the teacher dur 
ing the class period. Such data would probably be fairly objective 
But such data will probably have little validity. That is, such items 
will probably not be determining factors in good teaching. This 
point seems to have been overlooked by some supervisors. 

To further illustrate this point, let us suppose that the super 
visor has collected the following data: 


TYPE oF COMMENT Frequency 
COE GUI obo. ce cerestserievascionsceces 13 
CONSE SOMITE 6 ok ccciccestevecnesssccnsudecs 2 
Se ES oc Srreenewnnk$encsdd eee ndewenwese 1 
ON DEINE 6.0 c adovcnvcacs Senéecbi ieeceseasesans 12 
REPTES SEED oo. Fr ecccdccevasesiscedécceenatanes 6 
Elucidates and elaborates pupil’s answer..........-.+6: 20 
Follows up with more questions to the pupil reciting.... 10 
Buppiies BOw InfOrmatiok.....ccccccccseccccesscsesscos 7 
Indicates relation between courses and parts of courses.. 3 
Gives interesting stories, anecdotes, illustrations........ 6 
Summarizes and formulates conclusions..............+.. 2 
Explains meanings of words, diagrams, pictures, etc..... 5 


With these data at hand what should the supervisor say to the 
teacher? Is this teacher efficient or inefficient? Are the teacher's 
comments well made? Well, the truth of the matter is that no on¢ 
knows. The data are objective enough, but if the supervisor inte! 
prets them to suit her own purposes the supervision is not scientific. 
The interpretation must be based upon statistically determined 
standards of teaching performance or experimentally determin¢ 
principles. This is a matter of some importance that some super 
visors seem to have overlooked. 

It has not been the purpose of this paper to offer a summary of 


the results of a series of investigations but rather to state a problem 
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Supervision as now ordinarily conducted is highly subjective.’® 
How can supervision be made more objective? It is the writer’s 
opinion, in the light of work done to date, that the answer will prob- 
ably be found in experimentally determined laws, facts and prin- 
ciples of learning and teaching, each accompanied by an objective 
deseription of the proper method of application to teaching itself, 
the method of application being expressed in terms of specific 
teacher and pupil activities qualitatively and quantitatively de- 
scribed. Thus, as written examinations were systematized, checked 
for validity, reliability and objectivity, and issued as standardized 
tests, there would seem to be some reason for similarly systematizing 
he observations of supervisors, testing these observations for valid 


reliability and objectivity, and issuing the systematized ma 


terials ultimately as standard items to observe. 


*The reference here is, of course, to studies of the teaching process and 


the study of results of teaching by standardized tests. 





THE HOW TO STUDY PROBLEM 


Joseru 8. BUTTERWECK 
Assistant Professor of Education, Teachers’ College, 
Temple Unwersity, Philadelphia, Penn, 


THE HOW TO STUDY PROBLEM 

‘*Strawberries may come and strawberries may go, but prunes 
we have with us always.’’ In such words the comedian calls atten- 
tion to the prevalence of the commonplace in our lives and the ocea 
sional sporadic spurt of genius. If he were reviewing the nature 
of our educational progress of the last half century he would no 
doubt find ‘‘prunes’’ everywhere, but the luscious fruit would bi 
in evidence on rare occasions and its seasons of short duration. 

If he were limiting the scope of his activity still further and 
would apply his pun to our attempt to solve the ‘‘how to study”’ 
problem I fear that he would hardly find enough genius to permit 
the green berfy to assume a hue so deep as to make it tempting. 

A review of our attempt to solve this problem reveals an abun 
dance of activity within the realm of mediocrity—an abundance of 
swivel chair opinion, an abundance of generalizations from a few 
stray and often manipulated facts, a verbosity which has been : 
equalled only, in the past and present, by new sciences in embryo.’ | 

A. We started our attempt when the educator was not a sci- 
entist, but when his chief problem consisted of selling his wares, o 
eonvineing the publie that to study is a mark of good breeding, of 
culture, and when ‘‘how to study’’ had to be interspersed with ar 
abundance of ‘‘what to study’’ in order to make the product 
salable. Whether the advice came from the pen of a Locke or 
Bacon, a Watts or Sandwick, whether written in the seventeenth 
or the nineteenth or twentieth century the same motive dominated 
the writer and the same method was used, the difference in genius 
probably being reflected by the degree of development of the embryo 
science at the time the advice was penned. 

B. In the course of time a new science was conceived and its 
embryo began a rapid development. Its growth was more rapid 

* For a more detailed summary of the attempts to solve the study problen 


chapter one of The Problem of Teachina Hiah School Puptls Tlou 
Study, Jos. S. Butterweck. Teachers College Contribution No. 237. 
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all edueational activities. So as the accepted philosophy of edi 
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n that of education because it was fed on a better diet—the diet 

f objective evidence based on experimental data, and although 
good deal of this evidence was collected from animal subjects rather 

an humans and a great deal of it was too meagre in amount t 
permit of the sweeping generalizations deduced from it, material 

s provided for a second attempt to solve the ‘‘how to study’”’ 
roblem. Deductions from generally accepted psychological prin 
ciples became the accepted means for teaching pupils how to study 
Whether these deductions were made by a Whipple or by the 
editors of our high school handbooks the purpose was the same, the 
difference in genius being determined by the degree of originalit) 
ised by the writers. 


C. Any new science is developed into maturity by 1 


e 
f a large amount of the opinion of the philosopher Edueational 
trend has been dominated by the formulation of the experiences of 
the past into a suggestive program of action intended to solve the 
roblems of the present Obviously, as the ‘‘experience of the 


st’’ accumulated and the ‘‘ problems of the present’’ became mor 
a plex the philosophy of ed eation el ana d. A resniti o nhil 


Vy of education onee gener: Hy acct pted becomes the measure fot 


iu 


ition developed through Herbartianism into Deweyism the ‘‘how 


») study”’ problem took the form of critical analysis, comparison 


ganization, and the like, and added the philosophic motive fon 
f purposefulness. The result, whether coming from the pen of a 
IeMurry or one of the lesser lights was the same—an effort to solve 
( ‘how to study’”’ problem by measuring its effectiveness in 
erms of an aecepted philosophy. 


Are these three methods of attempting to solve thi nroblen 


entifie ? Not if science rat mands objective evidences AS 1S hasis 
denes eolleeted from the situation at h nad resultit rin emed »] 
easures applied to the situation at hand. 


D However, the ‘‘how to study ed problem eould not 


entirel) 


‘ape the demand that education grow from its embryo into 

| : : . 1 . » il . : “1 x ‘ 
dgling science, and so we had to find out what pupils do when 
ey study. However, with very few exceptions did the data thus 
lected enlighten us further than to suggest the time, place, and 


mditions under which such studving is being done, nor did it 
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attempt to distinguish between the successful and unsuccessful 
pupils and thereby provide data which might become the basis for 
a constructive program. Although we have had a departure from 
the ‘‘prune’’ diet the berry was not ripe enough to tempt us to eat 
heartily of it. 

This leaves us in the midst of an unsolved problem with an 
almost unexplored field ahead. It is the field which has becom 
the popularly accepted method of solving any problem—the scier 
tifie method. This requires an enormous amount of fact gathering 
and an even larger amount of experimentation. Like Rome it 
cannot be built in one day. It requires the collection of data whic! 
will help us determine what pupils do when they read for the pu 
pose of studying, what they do when they are solving an original 
in geometry, and the like; also what pupils of high intelligence di 
and what those of low intelligence do in each of these study situa 
tions, what successful pupils do as compared with unsuccessft 
pupils. We must also determine what effect the classroom methods 
of the teacher have upon the study method of the pupil for each of 
these study situations.2 Only then are we in a position to develop 
a sound technique for teaching pupils how to study for only then 
are we safe in stating the method which a particular pupil should 
use in a particular study situation, and only then are we in a pos 
tion to give a teacher concrete suggestions as to what technique lh 
should use in getting the pupil to adopt better study habits. 

This may result in a radical reorganization of our teaching 
methods, it may remove emphasis from knowledge of content ma 
terial as our outcome in teaching and fix it upon method of work ot 
method of thinking, it may tend to make us more than ever cor 
scious of the fact that the value of any particular bit of the content 
of a curriculum is not inherent in content, but is determined by the 
method which is used in teaching it, or rather in guiding the learn 
ing activity of the pupil. We may even find out that the degree of 


transfer of training resulting from anything which is being learned 


?For a more detailed account of a scientific attack of this problem s 
‘The Problem of Teaching High School Pupils How to Study’’ by Jos §S 
Butterweck, pp. 81-89, Fourteenth Annual Schoolmen’s Week Proceedir 
University of Pennsylvania. 1927. 
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materially enhanced if the product of the learning is a method 
f attack rather than an accumulation of factual knowledge. 
But, if we are to build a sound program of outcomes around 
hod of work, method of thinking, method of study, method of 
ig, we must know what methods are best for a particular 
in a particular learning situation and what methods of 
teaching will best result in bringing about in the pupil the par 


ilar study method desired. We have barely begun to answer 


PSE questions. 


What do pupils do when they study? What do they do when 


read an assigned lesson for the purpose of study, for the 


if extracting the meat from the printed page? We hav 


7 


? been told what they should do by MeMurry, Book, and others, but 

they have told us is not based on objective evidence but is a 

mbination of opinion and deductions from principles generally 

‘epted by the philosopher and the psychologist. If we find that 

study activities engaged in by pupils do not coincide with those 

lvoeated by these ‘‘authorities’’ then should we continue to insist 

hey are necessary to suceessful achievement or should we 

fy our suggestions to meet the findings; or, if we shall con 

ie to insist that our deductions from generally accepted prin 

les are correct how shall we get pupils to adopt them in practice? 

Purpose of This Study. In the hope that a little light will be 

Vn on oul study proble m the write! tempted to find out what 

ls do when they are confronted with the problem of extracting 

e meat out of the printed page, and what difference if any exists 

en pupils of high intelligence and those of low intelligence, 

1 what difference if any exists between the successful and the 

iceessful pupils if success is measured in terms of 
proportion to ability to achieve. 


An effort was made to collect evidence with respe et te ive ren 


erally accepted desirable methods of work: (1) the reading should 
irposeful, (2) if purposeful it should result in a selection of 

e things which will satisfy the purpos 3) certain activities 
ild be engaged in during the readi y” to insure thoroughness. 

+) reeall of that which has been read is an aid in fixing the essen 


facts to be re membered, (5) a final review of all that has been 


irned se rves to clinch as well as to give unity to that which is being 
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studied. (It will be noticed that there is considerable overlapping 
in these five desirable study activities particularly as they are re 
lated to ‘‘thoroughness.’’ If recall is practiced a higher degree of 
thoroughness is the result; if review is practiced greater thorough- 
ness is the product; if a greater amount of selectivity of essential 
facts is practiced greater thoroughness quite likely follows. How- 
ever, the writer thought that probably the only difference between 
the successful and unsuccessful pupil consists in the difference in 
pains which the suecessful pupil takes in the preparation of his 
lesson, devoting more time to it, repeating more frequently, observ- 
ing more carefully, and the like, that the difference might be on 
of quantity rather than quality. It is this concept of thoroughness 
which we are trying to measure. ) 

Procedure. Ninety-eight teachers-college freshmen taking a 
course in Introduction to Education were used as the subjects. The 
intelligence scores used herein are Alpha scores obtained by giving 
Alpha test Form VII. The achievement scores are the term marks 
for the course ‘‘Introduction to Edueation.’’ These marks repre 
sent an average of arbitrarily weighted daily quiz scores, unit tests 
and a term examination, each marked on a point basis rather than 
percentage basis, each test and quiz so difficult that very few if any 
obtained a perfeet score. This provided for each test or quiz a 
wide range of marks distributed in a manner approximating a 
normal curve. All tests and quiz marks were expressed as T-scores 
before averaging. The writer feels that the quizzes and tests were 
frequent enough and so administered and treated that the final 
score (achievement seore) represents relative achievement in the 
course. Suecess in proportion to innate ability is expressed in terms 
of the sigma difference between intelligence and achievement and 
is hereafter referred to as the Studious Index. 

After the course had proceeded for a period of a month—long 
enough it was felt for the freshman to become adjusted to his en 
vironment, the school, instructor, and the course—each student was 
asked to bring his textbook (Cubberley’s Introduction to the Study 
of Education) to class the next hour as well as paper and pencil. 
Upon presenting himself the next hour each student was asked to 


* The method of determining this Index is more fully explained in Chapter 
2 of T. C, Contribution No. 237 referred to before. 
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open his book on page 149 and devote thirty minutes to studying 
the content of pages 149-159 in the manner in which he was accus- 
tomed to study such an assignment. During this time the writer 
engaged in moving about the room and observing such mechanical 
habits of study as notetaking, underscoring, outlining, and the like, 
so that at the end of thirty minutes the writer had a list of students 

o engaged in each of these activities in so far as these could be 
observed. (Classes ranged in size from thirty to fifty.) The re 

nder of the hour was used in having each student give a written 
esponse to the following questions: 

1) Did you finish your studying? 

2) If not, where did you stop? That is, what more would you 

ve been likely to do if you had the time? 

3) Explain step by step what you did when you studied the 

son If you read the lesson carefully paragraph by paragraph 
then state this as one fact; if you underlined, state this as another 
The class was encouraged to enumerate these steps in full 

nd to list them after numbers indicating separate steps. 

1) Were you at any time given specific directions in How to 
Study? If so, explain briefly what you were told to do when read 
ng or studying in a situation such as the one which just confronted 
you 

This was followed by a series of factual questions intending to 
etermine the quality of the study during the thirty minute pe riod 

hese papers were then collected together with the notes which 
had been taken by those students who engaged in notetaking during 
their study. At the next meeting the work of the class proceeded 
s usual without reference to this departure from our regular 

puting About a month later the same procedure was followed 
th another chapter in Cubberley’s textbook, again without com 
nt as to the purpose. 

About a month after this each student was given a question 
ure, the purpose of which was to determine what specifically he 
id been in the habit of doing while preparing the assignment from 
the textbook used for this course. The method of the questionnaire 
was that of having the student check the activ ity or activities which 
most nearly applied to his particular method of reading for the 


purpose of studying. 
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Three types of responses were thus elicited: (1) the student’s 
own statement as to what he did in a particular study situation, 
(2) the instructor’s observation of the student activity, (3) the 
student’s response to a questionnaire the method of which was that 
of having the student select from a large number of possible activi- 
ties the ones which represent his study habits in a particular type 
of study activity. The first was in the form of a recall of what had 
just been done by the student. The second a record of what 
someone else had observed him doing. The third a recognition of 
the activities which formed a part of his study habits. An attempt 
was then made to combine these three student responses into one, 
by selecting common elements in the light of the five types of study 
habits to be studied. The general principle used in securing this 
composite was to determine the extent to which the first two corro- 
borated the third (the questionnaire) and if no such corroborative 
evidence existed it was concluded that this was not a usual part of 
the stud@nt’s study activity. 

Purposefulness. The students were divided into three groups 
with regard to the degree of purposefulness evidenced in their 
study: (A) those who manifested a distinet evidence of purpose or 
aim; (B) those with whom there was a clear evidence of no purpose 
or aim; (C) those for whom the evidence was so conflicting that it 
was impossible to place them in either the (A) or (B) group. 

Each of these three groups was subdivided into two: (1) those 
for whom the evidence pointed to a study of the subject matter as a 
whole; (2) those who seemed to be concerned with studying a para- 
graph or section until its content was mastered, and then proceeded 
to the next paragraph or section and in this manner continued until! 
the whole had been niastered. 

Approximately 6% of the ninety-eight students belong to the 
A-1 group (those giving evidence of a purpose or aim in their study 
as applied to the lesson as a whole) and 10% belong to the A-2 
group (whose purposefulness applies only to individual paragraphs 
or sections and not to the lesson as a whole). 

One-half of the total number of students belong to the B-1 group 
(studying the lesson as a whole without having in mind any definite 
purpose in their reading but simply noting new facts in the reading 


, 


as they present themselves); and 28% belong to the B-2 group 
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studying the lesson by paragraphs or sections but doing so without 
ving any definite purpose in mind except to extract facts as they 
present themselves). Only 7% were placed in the C or doubtful 
group. 
The following type of activities were accepted as giving evidence 


of a purpose or aim in reading: (a) skims to get gist of lesson; 





looks at paragraph headings and then reads for supporting 


% 
details; (e¢) reads over lesson as a whole so as to get general idea 
@ f lesson: (d) reads questions at end and then reads to answer these 


questions; (e) looks at summary sentence or paragraph and then 
s reads for supporting details. It must be remembered that this pur 
posefulness applies to the lesson as a whole for some and to indi 
lual paragraphs or sections for others. 
What difference, if any, exists between those of high and low 
ntelligenee and those of high and low studiousness if the quantita 


,@ 


tive measure for the relative achievement is the ‘‘Studious Index’ 


Space does not permit giving more than the outstanding differences 
Among the 16% who give evidence of purposefulness (the A 
ip above) there seems to be no marked intelligence difference, 

ist a few more being included among those of above average in 

telligenee (Alpha score of 134) than among those of below average 
lligence, except for the fact that only one-fourth as many 


Le 
ppear in the lower quarter of intelligence as would be expected 
equally distributed. This type of study habit appears to be 
re common among those of below average ‘‘studious index’’ than 
mong those of above average ‘‘studious index’’ by the ratio of 
2.8 to 1. 
‘his seems to point to the conclusion that students of average 
d above average intelligence and low relative achievement are 
more likely to be purposeful in their reading to study, than those of 
w intelligence and high relative achievement. This conclusion 
corroborated by the 78% who compose the B group (clear evi 
ence of no purpose or aim). 
Selectivity. The following activities were recorded as giving 
dence of selectivity: (a) selects certain parts to be memorized 
reported by 19%: (b) underseores what he thinks important 
©; (e) takes notes of important parts—55%; (d) selects sig 


ant point of each paragraph—26%; (e) outlines while read 
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ing—9%; (f) outlines after reading—15%; (g) selects mentally 
what seem like important points to be remembered—33%. 

There seems to be no intelligence difference with regard to 
selectivity except that those in the lowest quarter are less likely to 
‘*seleet mentally what seem like important points to be remem- 
bered.’’ What little difference there is between different levels of 
relative achievement points to the conclusion that the more suecess 


sé 


ful students are more likely to ‘‘select certain parts to be memor- 
ized’’ and ‘‘outline while reading.’ 

Thoroughness. The following activities were considered as giv 
ing evidence of thoroughness: (a) re-reads difficult portions—re- 
ported by 82%; (b) outlines what he reads—73%; (ce) studies or 
memorizes parts considered important—73%; (d) notes references 
and footnotes—25%; (e) notes diagrams, pictures, ete—40%; 
(f) puts thought of significant parts into a mental sentence—13% : 
(g) relates what is studied to what has gone before—25%. 

Those of above average intelligence seem to indulge more fre 
quently in ‘‘outlines what he reads,’’ ‘‘notes diagrams, pictures, 
ete.,’’ ‘puts thoughts of significant parts into a mental sentence’’ 
and ‘‘relates what is studied to what has gone before.’’ Students 
of above average relative achievement reported more frequently 
that they ‘‘put the thought of significant parts into a mental sen- 
tence’’ than did those of below average relative achievement by the 
ratio of 2 to 1. 

Recall. (a) Thirty pereent reported practicing no recall; (b) 
15% practiced recall but did not mention the nature of it; (¢) 2% 
as a difficult or important passage is met; (d) 13%, after lesson 
has been read or studied as a whole; (e) 21%, by trying to answer 
questions at the end of the chapter; (f) 3%, by trying to answer 
self-made questions, and (g) 39%, occasionally while reading. 

There seems to be no intelligence nor relative achievement dif- 
ference in the practice of recall except that ‘‘no reeall’’ is reported 
more frequently by those of above average intelligence. 

Review. The following types of review are reported: (a) fol 
lows same method as at first reading—11%; (b) review is in form 
of a hasty view of what has been read—-12%; (¢) review is in form 


of a careful study of what was previously selected as important 
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17%: (d) review follows same method as at first reading but 

somewhat higher degree of selectivity—42%. 

Students of below average intelligence reported ‘‘review by ap 
roximately same method as at first reading,’’ 2.7 times as fre 
ently as those of high intelligence; ‘‘review is in form of hasty 
ew of what has been read’’ is reported 1.7 times as frequently by 

= those of above average intelligence; ‘‘review is in form of careful 
study of what was previously selected as important,’’ by 1.8 times 
ny students of above average intelligence as by those of below 


ve intelligence. 


et. an tipthy 


we consider methods b. ¢, and d the most efficient methods 
view then we find that those of above average intelligence 
oy this method about 1.5 as frequently as those of below aver 
telligence but that there is no difference between those of high 
ose of low relative achievement. 


Conclusions. In drawing conclusions from these data we must 


Rete Rein nities ay 


n mind certain weaknesses in the study. (1) The number 


; 


s which we have are too limited to suggest a finality to the 


: ons even if no other weakness existed. 2 Has actual 
: evement been measured in the scores used for this purpose? 
t ter tried to incorporate sufficient elements to Insure reason 

\7 e validity but he ean offer no absolute proof that a high validity 

i ] } 


ted, 3 Kven if the achievement seores offered reasonable 
re we right In assuming that the ‘‘studious index’’ as 

n defined measures relative achievement? 
However with these limitations the following conclusions are 
gevested by the study. (1) At least 50% of college freshmen who 
d for the purpose of studying manifest no purposefulness (in 
the sense in which writers on ‘‘how to study’’ refer to this term) ; 
e underscoring and note taking as types of selectivity; reread 
ieult portions, and memorize parts considered important to 
re thoroughness. (2) From 25% to 50% of such stude ni do 
reading by paragraphs rather than the lesson as a whole 
the significant point of each paragraph, and select mentally 
seem like important points to be remembered, as types of 
erectivity; note references and foot-notes, note di igrams, pictures 
el nd relate what is studied to what has gone before, to insure 


practice no recall and use recall occasionally while 








76 JOURNAL OF EDUCATIONAL RESEARCH [ Vol. 18, No.1 


reading; and in making a review follow approximately the same 
method as at first reading, with emphasis on those parts which had 
been previously selected as important. (3) Less than 25% practice 


the following study methods which are usually classed as necessary 
for intelligent study; give evidence of a purpose or aim in thei 
study; using the outline method either while reading or after read 
ing; put thought of significant parts into a mental sentence; prac 
tice reeall after the lesson has been studied or read as a whole; tr 
to answer questions at the end of the chapter; try to answer self 
made questions; review by studying carefully what was previousl: 
selected as important. (4) Students of above average as compare 
with those of below average intelligence are more likely to study 


the lesson as a whole with a purpose in mind, underscore what the 


think important, outline after reading, select mentally what seem 


like important points to be remembered, note diagrams and pictures 
put the thought of significant parts into a mental sentence, relate 
what is studied to what has gone before, practice no recall, review 
in the form of a hasty view of what has been read, and review ir 
the form of a careful study of what was previously selected as in 
portant. (5) Those of below average intelligence are more like): 
to follow in their review approximately the same method as at first 
reading. (6) Those of high relative achievement are more likels 
to select parts to be memorized, underscore what they think im 
portant, put thought of significant parts into a mental sentenc 
practice recall by answering questions at the end of the chapter 
review by following approximately the same method as at first 
reading. (7) Those of low relative achievement are more likely t 
have a purpose or aim in their reading (this seems incongruous but 
shows up decidedly in this study); they are also more likely 


outline while reading. 


Is such a conelusion an indictment of our methods of teaching 


pupils ‘‘how to study’’ or of the method of study which we ad\ 


ite as being the best? If results in the form of pupil learning 


outcomes are to be considered the measure of our sueecess then we 
must aseribe near failure to our efforts. 


} 


Would it not be wise to repeat such a study in varying situati 


determine wheil er rrobo iting ¢ Vice nee exists ? 


' 























% EDITORIALS & 


sal dL HUHUUNNNUGUNNUHANNUOD AANAAUAURAAAATOOORANTTUEAAGA TOO DOEAD OO EOAE ASTRAY AAA 


PUERCO PULLORUM ECPM GREER bo 


SeUUMOAMAL! 11! (HALAL 


A BELATED ACKNOWLEDGMENT 
NEARLY four years have passed since the r¢ port of the Classical 


gation was published. We cannot say that the occasion was 


. ; 
Inves 


arked by an outburst of interest on the part of educationists. 
McAndrew had something to say about the report in January, 1925 
Judd paid his respects in February. Rugg devoted a few 

ves to it about a year later when he was summarizing in the 
'wenty-Sixth Yearbook of the National Society the work of various 
ttees in ecurriculum-making. That is almost all, and since the 
writers we have just mentioned were more or less unsympa- 


there is more than sufficient ground for representing the 


n of educational people to the report as distinctly chills 
Yet the report was certainly a remarkable one. The United 
States Commissioner of Education was led to say after serious con 


on: ‘‘There never has been a study ol a secondary school 

ect made in the history of education in our country which com- 

res in its comprehension and in its thoroughness . . . . with the 
that has been made by the [Classical League].’” MeAndrew 

speaks of ‘‘the refreshing honesty that permeates the entire report’’ 
| Rugg admits: ‘‘There never has been another committee report 


vhich statements coneerning aims and objectives, the content of 


course, and methods of teaching. have he en bast d SO compl Te ly 
by page, upon quantitative data.’’ The study therefore even 


nes out of the mouths of its severest critics wins commenda 
n. Judd is the only one who yields nothing. To him the report 
lefensive’’ in tone and ‘‘amateurish’’ in method. Moreover, his 
‘le is unrelieved by any expression of good will. That’s one of 
factions one gets in reading an article by Judd—you always 
where he stands. Moreover, when he speaks of his ‘‘disap 


} 


ntment’’ with the report of the Classical Investigation, you 
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know that he is enduring the disappointment with admirab\ 
equanimity. 
Why must the critic—as a critic—be a protagonist at all? Most 


of the writers who have referred to the report on the Classical In 


vestigation have consulted their prejudices. They are either ‘‘for”’ 


Latin as a school subject, or they are ‘‘against’’ it. If they are for 


Latin, they praise the report; if they are against Latin they con 
demn it, or they are ‘‘disappointed’’ with it. The criticism of th 
report gets all mixed up with a problem which the report did not 


attempt to solve, namely, whether or not Latin should be taught to 


1 


anybody. Rugg, for example, says, ‘‘They |the writers of th: 


Classies report] never really question the wisdom of teaching the 
existing content. They assume that it should be taught’’ [italics 


Rugg’s|. 

Now one of the easiest and most superficial types of criticism i 
that which accuses an investigator of not doing something he never 
undertook to do. The Classics Committee, as was repeatedly an 
nounced both prior to the publieation of the report and in the report 
itself, was to ascertain definitely the ‘‘ present status of Latin and 
Greek’’ and to prepare ‘‘A constructive program of recommenda 
tions for improving the teaching of Latin and Greek.’’ One wou 
suppose that the only fair basis of criticism would be to start wit! 
this purpose in mind and then to examine the extent to which the 
committee carried out its purpose. If I agree and contract to w 
from Columbus to Cleveland, it is obviously unfair to eriticize mé 
for not walking to Buffalo. It is like the series of questions levele: 
at Dr. Moore, one of the staff of the New York City Survey Com 
mittee after he had brought out his report on the administration o! 
the school system of New York. The political administration did 
not like the report, so they proceeded to heckle the writer. Moor 
‘said the questions were as if, having been commissioned to travel 
from New York to Boston, he had been asked what he saw in Phila 
delphia on the way. 

The Classical Investigation assumed, and it had abundant right 
to assume, that Latin was being taught and that for a considerable 
} 


ut 


period in the future it would continue to be taught. One may 


lieve that far too many children are studying Latin and may give 
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chapter and verse to support one’s belief; but such a belief and such 
supporting data will have nothing to do with the problem proposed 
by the Classical Investigation. On the other hand, one may believ« 
that every boy in school should study Latin and conceivably one 
may make an argument for such a belief; but again this is quite 
outside of the purpose of the Classical Investigation. In reality it 
makes no difference how many children are studying Latin. The 
investigation takes things as it finds them and seeks to improve 
them—surely a worthy undertaking. 
Accordingly, it seems to us that the educators, who ought of all 
others to have weleomed an objective study of the teaching of thi 
assics, either kept silent when this important study was brought 
to publie attention or else they were guilty of criticizing the in 
vestigating committee for failing to carry out a purpose which it 
at no time entertained. Such eriticism exemplifies a genial custom 
ilmost as common as ‘‘ passing the buck’’ which may be deseribed 
as the careful setting up of a straw man for the purpose of solemnly 
knocking him down. 
One need not be greatly disturbed by the partisanship of the 
investigators. Is it to be expeeted—human nature being what it is 
that a committee composed of the teachers of a subject will dis 
play hostility or even indifference to that subject? Isn’t it recog 
nized that the opinions of those who know most about a subject have 
practical value; and if the persons selected as competent to form 
n opinion have no sympathy with the matter under discussion, will 
not their opinions be of less value? It is our belief that among all 
the committee reports with which the Classical Investigation may 
be compared none is so free from partisanship, none so free from 
special pleading. It is true that the last chapter of the report is 
tinctured with propaganda, but this chapter constitutes less than 
one-tenth of the entire bulletin. Moreover, this chapter is so 
different in tone and treatment from the rest of the report—being 
probably written by another hand—that the veriest tyro in criticism 
ght easily to set it apart from the other nine-tenths of the report. 
We know of no valid eanon of criticism which would permit one to 
estimate the entire report from a consideration of ten percent of it. 
It is customary to praise a report if it is ‘‘eonstructive.’’ Here 
we think the Classical Investigation is entitled to commendation. 
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It has given in detail both a method and a content for use in the 
improvement of the teaching of Latin. This part of the report 
constitutes a critical evaluation of the existing materials of in- 
struction and reaches the conclusion that these materials, as well 
as the methods by which they are taught, are totally unsatisfactory. 
The committee by this means fearlessly clears the ground for its 
constructive reorganization. Thus the report is both frank in its 
treatment of existing conditions and constructive in its proposals 
for improvement. It is, as we have said, beside the point to argue 
that improvement in teaching Latin is of no consequence—to argue, 
in short, that the whole subject should be banished from the schools 
In fairness to the committee we must grant them their problem and 
eriticize their work by their treatment of it. It is here that we in 
education have failed to measure up to expectations. It is fair to 
assume that one of the reasons for our existence is the improvement 
of ,publie education. If our devotion to this cause is sincere, we 
should weleome a report such as the Classical Committee brought 
out. And this for the reason—if for no other—that the report in 
substance demanded freedom for the secondary schools to develop 
the study of Latin for the educational good of the greatest number 

The teachers of Latin have themselves welcomed the report, and 
from every quarter their healthy reactions to it have been mani 
fested. If no curriculum since 1924 has been formulated without 
reference to the Classical Investigation, if no textbook has been 
written or revised without claiming to exemplify its teachings, i 
no article by a teacher of the classies has failed to defer to it, then 
it ean searcely he said that the report was a failure. The Latinists 
without the assistance of the educationists are interpreting to the 
schools of the country the constructive program to which the Classi 
cal Investigation was devoted. 


B. R. B. 
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e has just appeared from the National Education Association a 
entitled The College of Tomorrot Its Relation to High School a 
This pamphlet contains one hundred annotated references beari1 
The references are drawn largely from magazines and have appears 


the last four years. All sides of the question seem to be presented, az 


a) i 
wishes to know what those who write on the subject are thinking 
good résumé from this annotated bibliography. 
During the present year, the Educational Test Bureau of Minneapolis h: 


stributing the Kuhlmann-Anderson Intelligence Tests which consist 
five separate tests. The first one is easy enough for five-vear-olds 
s so difficult that no adult has ever been able to pass all of it. The 


re combined in groups of ten for various age abilities from pri 


~ 


igh school, each group overlapping with the previous grou] rhe 


luable addition to the field of mental measurement 
lts of {chievement Tests Gwen wm 1926-27 vi) the Eleme ta 
Schools of Michigan is the title of a University of Michigan bulletin by 
G. Bergman (Bureau of Edueational Reference and Research, Bullet 


The results are presented in a large number of tests by individua 


g 
and groups of similar size. When the results of all tests are consolidated 
nd that Michigan, as a whole, is just slightly below the grade level 


tion in Grades IX, X, and XI, while Grade XII is almost a full year 


the level. 


On the basis of the Otis Classificatix Test used in January, 1928, in tl 
of Miami County, Ohio, Superintendent Sellers reports that of 487 
ide pupils, 36 percent were up to their classification or better KF 
ent types of schools the percents are as follows: centralized and village 
+] percent; two and three-room schools, 27 percent ; me-} 1 
ll percent. This seems clearly to indicate that the pupils of tl 
ts are greatly behind grade standards as compared with the 


el Studies of Scientists in the United States by Ching-Ju Ho has 
blished by Teachers College, Columbia University, as No. 298 in tl 
f Contributions to Education. The author has studied the vocational 

es of approximately ten thousand prominent scientists in twe 
s and has attempted to answer questions regar 


81 
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Der n the various sciences, the necessary preparation for. the routes 
ess in, and other personnel factors of the different scientifi professi 


It is an additional contribution to the field of vocational guidance. 


Charles D. Dawson, assistant superintendent of schools in Grand Rapids 
Michigan, has recently issued a special report on city failures of pupils for th 
past ten years. The tables show that the greatest percent of failure occurs i 
Grade I, with slightly more failures in June than in January. In about three 


rths of the cases the smailest percent of failures for elementary buildings 


has been in the high eighth grade. In only five of the eighteen semi-anr s 
reports included in the study has the lowest percent of failure been in s 


’ 
other grade. 


The United States Bureau of Education distributed at the Boston meet 
f the Depar*ment of Superintendence an advance multigraphed copy of 
ibliography of current research studies in education. Seven hundred sixty-t 
different studies classified under forty different heads are reported. 


Bureau plans to issue later, in printed form, a bibliography giving descript 





and abstracts of research studies in education completed during the acader 
ear ending June 30, 1927 
( irses for the training of teachers of sight-saving classes are s 
given this year at the University of Chicago, the University of South 
California, and the University of Cincinnati Mrs. Winifred Hathaway, ass 
inte director of the National Society for the Prevention of Blindness, stat 
at one of the chief reasons why there are only three hundred sight-s: 
classes in the United States and Canada while more than five thousand 
nee led, is that few teachers have the propel training and personal qual 
tions for this particular kind of instruction 
Those of our readers who wish to secure material for debating clubs 
questions of foreign policy, or who may wish to keep themselves clost 
touch with this field may be interested in knowing that there is a Foreig 
Policy Association with national headquarters at 18 East Forty-first St 
New York This association publishes a weekly news bulletin and also has ! 
leveloped a fortnightly information service which wor exte 
material on special topics. Information service reports h¢ App 
ering social, economic, and p litical questi S in near art I 
- } 
Dr. E. R. Downin of the Universit f Chicago, has devised a rat 
teet elementary sciences or tire stud The test consists f 
. ! trat ns for each oracde The same material Ss presente 
ren from Grades I to VIII inclusive, but the reaction requested 
Grade I 1 Il reeognize a specifie picture I ng a cross the 
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es V and VI interpret; and Grades VII and VIII show further informa 
egarding the different things illustrated by answering more complex 


stions. These tests are now being standardized and can be secured fror 


{ recent Congressional decree in Colombia provides for the foundation of 


tional university along the most modern educational lines. New schoo 
rmacy and dentistry will be added to the already existing faculty of 
e and natural sciences of Bogota. In the faculty of law and political 


d social sciences 


es, courses leading to a Doctor’s degree in economics a1 
izes the rovernment to send not 
an tour students every year to foreign countries for a two-year period 

lhe scholarships will be distributed among students who have dis 
shed themselves thri 


igh their studies in fields of art, commerce, ind 


Division of Educational Research and Results of Philadelphia has 
S 1 its report to the Board of Edueation on the work of the schools 
1926-27. Educational measurements in arithmetic, algebra, geography 


health knowledge, spelling, reading, English, and handwriti 


Pe 9 ne are 
In addition, a large number of the activities of the division, su 
3 al sis of promotion rates, educational guidance, curriculum constructior 


ve test construction, publicity, and so forth, have occupied the attentior 


1} i 
workers in the Bureau to a greater or less extent The ‘*‘Summary 
ngs’’ presents in concise form the testing projects, the conditions 
were found to be satisfactory, conditions which needed to be improved 
t prot s which are in need of further study. 
ret iry 18sue rt the Ed catwnal B ets of the New Jerse Stat 
t of Publie Instructior has called to « attenti 1 publ t ! 
t National Associatior f High-Scho Principals entitled Guida 
» f The subjects listed in this bulletin suggest its nge ¢ mate 
e, ‘*Guidance in Secondary Schools,’ 4 Plan of Orga ition f 
within the Secondary School,’’ ‘‘Methods of Givi Guida 


Essential Forms and Records.’’ The bibliography covers a number of 


o i ] vwraphies refere a the te he x 
es f vocational and educational fo it ind efere! . 
- ft st nm ¢ patior l infor tior n forms and record ¢ te 
ment and follow-uy he ¢ in the New Jersey State D 
P ic Instruction. savs of t} etir With such a manua 
. necessary to issue S ibus general terms.’’ 
We recently received from the Department of Reference and Res 


vew ‘Trier Township High School, Winnetka, Lllinois, three mime aphe 
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another discusses adviser-room scholarship; and the third gives scholars! 
statistics by subject. Among the pertinent questions which the Departme 
asked the teachers in that high school are the following: (1) Are boys unal 
to do as good work in English composition courses as the girls, or is it t 


that the methods of teaching in these courses are more adapted to girls th: 





to boys? (2) The boys’ averages are higher than the girls’ in the follow 
bjects: Algebra I-B, geometry II-A, geometry II-B, economics civies, I-A, | 
general science I-A, biology II-A, chemistry, III-A, and typewriting. Wha 
are the reasons for this? 3) Why did the boys in Roman history I-B di 
much poorer work than those in Greek history I-A? (4) Why is there sucl 
variation in the scholarship averages in United States history III-A, and Ur 
States history ILI-B? 5) Why do boys and girls do much poorer work 
chemistry than in physics? These and a number of other pertinent quest 
should focus the attention of teachers on ‘‘why’’ in situations which are 
| to pass without question. 
The Health of the Teacher is a new publication of the Bureau of Ed 
t United States Department of the Interior Within this publieatic n 
the following eleven commandments: 
l Thou shalt have other interests besides thy schoolroom. 
2. Thou shalt not try to make of thy children little images, for they ar 
live little bunch, visiting the wriggling of their captivity upon you, the 
teacher, unto the last weary moment of the day; and showing interest a1 
cooperation unto those who ean give them reasonable freedom in working. | 


Thou shalt not scream the names of thy children in irritation, for tl 
will not hold thee in respect if thou screamest their names in vain. 


t+. Remember the last day of the week, to keep it happy. 
» Humor the feelings of thy children that their good will may speak w 


for thee in the little domain over which thou rulest. 


6. Thou shalt not kill one breath of stirring endeavor in the heart of a lit 
ehild 
7. Thou shalt not suffer any unkindness of speech or action to enter 
0 f thy room 
8. Thou shalt not steal for the drudgery of many ‘‘ papers’’ the prec 
hours that should be given to recreation, that thy strength and happi 


into all that come within thy presence. 
’ Thou shalt not bear witness to too many ‘‘schemes of work,’’ for n 


nay appear 
scattered effort is a weariness to the soul and a stumbling block to we: 
lingers. 
. Thou shalt not covet thy neighbor’s room, nor her children, nor her man 
ghbor’s, but work out t! 


only don’t let anyone know a 


r her system, nor anything that is thy nei 
wn salvation with fear and tremblir 


the fear and trembling 


a 


11 Thou shalt laugh—when it rains, and wee, woolly ones muddy the fi 
when it blows and doors bang, when little angels conceal their wings 
wriggle, when Tommy spills ink and Mary flops a tray of trailing lett 
when visitors appear at the precise moment when all small heads h 
forgotten everything you thought they know. 

] 


And again I say unto you, laugh, for upon all these comman 


hang all the law and the profits in thy schoolroom 
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rhe fifty-ninth annual meeting of the Department of Superintendence will 


ld in Cleveland, Ohio, February 24 to 28, 1929. 


Ward G. Reeder, associate professor of school administration, at Ohio 

State University, and J. L. Clifton, state superintendent of public instruction 
Ohio, have recently prepared a Handbook for Rural and Village Boards of 
Kducation and Clerks tn Ohto. This is a manual of procedure for the conduct 

, the business of rural schools and is calculated to answer the most urgent 
estions which the board members and clerks of these schools face. The hand 


} 


published and distributed by the Ohio State Department of Education, 


O wad some power the giftie gie us 
To see oursels as ithers see us! 


so sang Burns many years ago, and it has not been the fault of the poets if 


ave not seen ourselves in this light. The following, which appeared in 
April issue of the English Journal, may give our readers food for reflection 


READ IT AND WEEP! 

Research is too much with us; late till dawn, 
Counting and charting we lay waste our powers; 
Dissecting Beauty into graphs to label ours; 
Dumb we become of soul; our hearts we pawn 
To tabulate, and diagram, check till we yawn. 

4 formula!’’ we’re howling at all hours; 
We trace the p’s and q’s to inmost bowers. 
From lyrie note and eestasy the glory’s gone: 
it moves us not. Ye gods! I’d rather be 
Victorian, nourished on Romance outworn, 
So might I, this efficient century, 
Glimpse foamy seas of faery lands forlorn, 
Look off my book, see Venus rising from the sea, 
Or hear in thunderous surge the Odyssey reborn! 

CARRIE BELLE PARKS 
State Teachers College 
Indiana, Pe nnsylvar ta 


‘he January issue of Teaching, published by the Kansas State Teachers 
ge of Emporia, contains the report of a survey of the Girls’ Industrial 
l, at Beloit, Kansas. The survey was made by Dr. E. R. Wood, director of 


Bureau of Measurements and Standards, and Dr. H. E. Schrammel, asso 


fessor of psychology. There are 148 girls in the institution whose 

ge at the time of commitment was 15 years 2 months. The median 

y f time that the girls had been in the school at the time of the survey 

slightly more than one year. On the average, the girls had not quite 

ted the eighth grade at the time of their commitment. Approximately 

1 of them were four or more years over age for their grade The 

ts of the survey, both from the educational and so« idlogical standpoints, 
pres ely with similar studies that have been made elsewhere 
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Paul V. Sangren, director of educational measurements and research at 


the Western State Teachers College, Kalamazoo, Michigan, has lately brought 


out in mimeographed form a valuable study of the validity of intelligence tests 
available for use with first-grade children. The tests employed were, in addition 
to the Stanford Revision, the Otis Group Intelligence Seale Primary Examina 


tion, A; the Rhode Island Intelligence Test, Form A; the Detroit First 


Form 


t, Form A; the Kingsbury Primary Group Intelligence 
Seale, Form A; the 


Grade Intelligence Tes 
Seale, Form A; the Presséy Primary-Classification 


Haggerty Intelligence Examination, Delta I; and the Pintner-Cunningham Pri 
mary Mental Test, Form A, 

These tests were all given to one hundred first-grade pupils, and the results 
analyzed according to certain criteria of validity. These criteria were: (1) the 
nature of the distributions of mental ages and intelligence quotients according 
to the several tests; (2) the conformity of these mental ages and intelligence 
quotients to normal central tendencies; (3) whole and partial correlations with 
r partially independent measures of intelligence; (4) the devia 


independent or 


mental ages and intelligence quotients taken singly or in pairs from 


tivall 
the mental ages and intelligence quotients on criterion measures of intellect 


the agreement among the tests on a threefold grouping of pupils. 


7 hie 


rhe author feels justified in listing tentatively the group tests in the order 


if their comparative validity. That order is: Haggerty, Pressey, Pintner 
Cunningham, Detroit First-Grade, Otis Primary, Kingsbury, and Rhode Island 

rhe United States Bureau of Education announced in April the establish 
ment of a new service in its Division of Rural Education. Miss Mina M. Lang 
vick, of Richville, Minnesota, has assumed the responsibilities of a specialist 
in rural-school curriculum. The types of service already established or in the 


process of establishment are the following: 


} 


1. General advisory and informational services through correspondenc 


movements i! 


lealing with curriculum problems and reports of progressive 
iral-school curriculum construction. 
2. Research studies dealing with such problems as the development of tech 


ies of procedure in curriculum construction, and curriculum units. 


Field service in connection with special research studies, and upon the 
ré rest of school officials concerned with the development of programs ot 


! 
irriculum construction, plans and techniques of procedure, preparation of 
irriculum units, and similar or related problems 


Miss Langvick has a Master of Arts degree from Teachers College, Col 


bia University. She has had direct contact with problems of rural education 


the one-room rural school, in the high-school teacher-training 


as a teacher iv 


departments of Minnesota, and as a county supervisor of rural schools in the 


states of Delaware, Maryland, and Indiana 
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t A REVISED ACCOMPLISHMENT QUOTIENT 

t In the January number of this magazine, William R. Wilson showed con 

S vely the fallacy upon which the accomplishment quotient is based. He 
nts out that it is virtually impossible for a child with a high intelligence 

quotient to have a high accomplishment quotient and that a child with a low 
telligence quotient will nearly always have an accomplishment quotient of 
re than 100. 

o The writer wishes to propose a new definition for the accomplishment 
tient which will not be subject to this criticism. The accomplishment q 
nt, as ordinarily used, means the educational age divided by the mental agi 

. [he proposed definition is that the accomplishment quotient shall be the ed 
tional age divided by the predicted educational age. The predicted educa 

. nal age is to be found by means of the usual regression equation 


ns follows: 


Predicted EA = r(MA mean MA) + mean EA 


Predicted EA “ 
In order to find the accomplishment quotient by these formulas it \ 
ssary to use the correlation coefticient between the mental 
eational ages, the standard deviations of the mental ages and the lu 
nal ages, and the means of the mental 


ages and the educational ages 
e calculation of the predicted educational age by formula (1) is not difficult, 
e the value of 


"EA 
o V { 
constant quantity. 


By the proposed method the average accomplishment 


qui ent for ar 
p will be 100, irrespective of whether the gr 


oup ranks high or low ir 
show how the group 


erage achievement. If it iS desired to 


tablished achievement norms, formula (1) should be chang 
nean MA for the mean EA. 


compares Wit! 


The use of formulas (1) and (2) for ealeulating the a mplishr t 
ent has the following advantages over the usual method: (1) The negative 
elation between the accomplishment quotient and the intelligence quotient 
liminated. (2) It is well known that the educational age of a group ter 
have a smaller range of distribution than the mental ag: The forn S 
re presented allow for this difference in standard deviations, whereas t 
her method does not. 3) If a elass or group has had inferior instructio1 
suffered from other common handicaps, the customary method gives to most 
the members of the group an accomplishment quotient below 100 F such 
up, the method here proposed yields accomplishment quotients in accord 
with the extent to which each member has availed himself of f I 


es offered him 


th Central High School, Spokane, Washinate . w. MK 
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/EGELEIN, L. BELLE (Comp.). List of Educational Subject Headings. Col 
umbus, Ohio, Ohio State University Press, 1928. xiv + 337 pp. 
Education as a subject of study, as a social science, as an art, has greatly 

enlarged its boundaries during the last generation. Concurrently there has 

‘*just growed’’ a chaotic and scattered terminology, confusing to readers and 

students. It has been difficult, almost impossible, for librarians, cataloguers, 

indexers, and members of research bureaus, who are charged with organizing 
for quick and easy use the fast-increasing printed matter in this field, to us 
this terminology. 

The book under discussion is the first competent and professionally a 
credited attempt to select and consolidate, and make authentic and serviceable, 
educational terminology. It was compiled by Miss Voegelein, reference assist 
ant in the Bureau of Educational Research, Ohio State University, in coopera 
tion with the National Education Association Commission on Coordination of 
Research Agencies. Its sponsors wisely do not offer a scientific and logica 
classification, although they played for a time with that alluring bibliotheca 
bomb. The chief purpose of this book is to index, not to classify. It offers a 
complete alphabetical list of all topies with which educational literature, ver: 
broadly regarded, is concerned. The inclusion and the exact form of eac!l 
topic have been carefully weighed. References are made to the form so chosen 
from every variant under which an active pedagogical imagination could fanc) 
that it would ever be sought by students. All related topics are firmly and 
fully bound together by cross references which have been chosen and arranged 
according to aceepted principles of cataloguing 

The larger subjects are again subdivided alphabetically to facilitate m« 
minute indexing or arrangement of the actual materials. It is quite possib! 
by imagining each heading as on an envelope, or other container in which ar 
placed the materials thus indexed, to visualize a combined library and inde 
ready for direct consultation without the use of an intermediate card cata 


logue. Such a unit, however, must be equipped with the requisite guides an 
cross references The numerous short notes which follow and explain thr 
scope and content of certain headings having other than educational connota 
tions are helpful and represent a new feature in formal lists of subject 
headings 

The making of a thoroughly good classification or list of subject heading 
in any field calls for more than a moderate knowledge of the content and tec! 
niques of two subjects. Miss Voegelein’s training and experience in both ed 
eation and librarianship assure one of the excellence of this laborious, metic 


lous, and exceedingly useful piece of work. 


gS 
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The book is well printed and tastefully bound. The pages have wide 
irgins for the inevitable additions. Brief but explicit introductory para 


iphs give all the needed explanations for using the book in different ways. 


Vew York State Library o. 1, Wim 


SMITH, DAvip EUGENE, AND REEVE, WILLIAM Davip. The Teaching of Junior 


High School Mathematics. Boston, Ginn and Company, 1927. viii + 411 pp. 
The development of the junior high school has been accompanied by a 
rked reorganization of the mathematics for Grades VII, VIII, and LX, and 
msequent improvement of teaching to present changed courses and to meet 
wly defined objectives. 

The recent book dealing with this task contains a discussion of these 
ectives, outlines the content and organization of the courses, and offers 
lance in the teaching of the materials. The units advocated may be 


escribed as arithmetic, intuitive geometry, algebra, numerical trigonometry, 


i demonstrative geometry. Several model lessons are given in detail, and 
| treatments of supervision and instruction, tests, home-made instruments, clubs 
ontests, and recreations are given. 

' Statements in the introductory chapter on the curriculum indicate that the 
| thors discount investigations for determining the mathematics used in adult 


and that they have based their choice of materials to be taught upon the 
m of teachers of mathematics. Yet they begin the next chapter by 
ng that ‘‘it shouid never be forgotten . . . . that the main purpose of 
aching arithmetic is to train children to compute accurately and with reason 
On 


e speed in those operations which they will probably use in later life. 
same page, they say that ‘‘ [courses of study] often tend to perpetuate 
solete processes, obsolete business methods. and obsolete terms, rules, and 
finitions that have no place in the modern school.’’ Certainly, the traditional 
rses here criticized have been the product of opinion, and the investigations 
vhich the authors discredit have done much to expose the uselessness of the 
aterial in question. 
In the lengthy chapter on objectives there are no citations to earlier treat 
nts of the topic, although the materials appear to have been considerably 


fluenced by such earlier work. Examination of one of the twenty-four refer 


es listed in the chapter bibliography leads us to wonder how much the 
thors are indebted to it. A sentence in the Preface, however, gives us the 
pression that the bibliographies are given to provide wider reading for 
tudents: 


Since the book will be used chiefly in institutions of collegiate grade and 
those preparing for positions of more than usual responsibility, there have 


been included numerous bibliographies and lists of questions and topics for 


scussion, (p. iv). 
Accepting this designation of those who will use the book we should expect 


t to do much toward familiarizing its readers with the contributions of the 
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more prominent workers in the field. Investigations are ignored, and the body 
of the text does not mention even such workers as Thorndike, Schorling, Clark, 
Woody, Buckingham, Courtis, Ruch, Buswell, Knight, and Wilson. There is no 
indication, in either text or bibliographies, that the authors are aware of the 
existence of about fifty Masters’ and Doctors’ theses which have been pr 
sented within the past three years and which have direct bearing upon th 


teaching of junior high-school mathematics. 


The insistence of the authors upon a unit of demonstrative geometry in thi 
junior high school is yet to be justified. It is highly significant. that in ter 
vears of this attempted reform Smith’s leadership has not been followed, a1 
investigations have not shown the desirability of such a unit. 

The chapter on tests gives us practically no information about ther 
(fter a superficial criticism of tests in general, the authors state six ‘‘ guiding 


principles underlying good tests. Then they present nine samples of their 
wn tests, saying: ‘‘If such tests are not included in the textbook used by t! 
eacher, he should carefully analyze the skills that he wishes the pupil 
master He should then make tests to fit that analysis and use them both as 
teaching and as testing devices’’ p. 044). With the exception of three lines 


ng he Rogers prognostic tests. no mention is made of any of tl 


t lardized tests 
One of the distressing traits of this book is the frequent expression of 
I e thought, particularly in matters of psychology and pedagogy. For ex 


mple, ‘‘What do you know about logarithms?’’ is cited by the author as 
being a poor question for the reason that ‘‘the pupil might properly answer 
‘Nothing’ and then claim full eredit for answering the question correct! 
p. 296 Many thoughtful teachers would consider the place of motivat 

n remedial treatment where the authors say that ‘‘if the pupils have not dor 
their part, [the teacher] is faced with a disciplinary problem’’ (p. 8). Ps 
chologists will be interested in this statement: ‘‘ Psychology has modified the 
adage that ‘practice makes pe rfect,’ so that it reads ‘interested pract 
makes perfect’ ’’ (p. 277). Here is a promise for the old gentleman who is 
greatly interested in golf but plays with his hands crossed. 

4 book with the serious faults and deficiencies just mentioned 

scarcely be recommended for use by students. They should have every oppor 
tunity to know about workers in the field and their findings. 


LEIGH SCHORLING 
Unwersity of Michigan RALEIGH HORI 


LEHMAN, Harvey C., AND Witty, Pau A. The Psychology of Play Actwitts 
New York, A. 8S. Barnes and Company, 1927. xviii + 242 pp. 
In this book the authors contribute what they believe are the initial 4] 


proaches to the problem of training children for a profitable use of leisuré 


that is, first, a quantitative study of what children actually do in their leisur 

















. 
} 
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ody : time, and, second, an evaluation of the many activities of childhood in terms 
ark f their individual and social worth. 

. rhe first three chapters give a short résumé of the changing attitude toward 


the ; play in which antagonism has been rapidly supplanted by appreciation. The 


Dre : uthors, however, do not dwell long on the educational philosophy of play. 


t hey assume that play is a ‘‘direct educative agent’’ and use a few apt q 
; ons from Dewey, McDougall, and others to substantiate this point of view 
. / One of the best chapters is that on ‘‘ Theories Which Seek to Expl n PI 
ry ; t is omplete, up-to-date, and penetrating. The authors content themselves 
4 with a clear statement of their researches of the various the ies , | 
npt to add anything original. 
In the fourth chapter, after considering the different techniques wl 
previously been employed in the study of the play behavior of children, tl 
4 ers fully explain their own technique. They gave each child who w teste 
; mprehensive list of two hundred play activities, and had him check thos 
he engaged in of his own volition, thos whi ] he like l ! Be. Ul ti 
ch he devoted most time, and those in which he participate | 


est of the book is concerned with the findings of this studv. 


These tests were given to more than six thousand school childr« ‘ 
: tv after preliminary investigations of smaller extent bee 
ling cities and rural schools. The findings are | é n gray 
! nclusions ure drawn concerning the effect upon pl | r ¢ 
ibles as age, sex, race, season, intelligence, comr t 1 other 1 ‘ 
‘ nelusions are sumr rized at the el of tl} 1 
r n addition to its presentation of a new technique f studying | 
rr and its contributions to curriculum construct the | c contal 
’ suggestions for future studies of | heha } ‘ | 
t, may be said to lie as much in its suggest sas s f ing This 
; rticularly true of the last chapter v nt P I to |} 
tion and Vocational Guidance.’’ The reader of T/ ] ] 
ictivtties will find an attractive, original, and scientific st fs f 
4 st important problems preval nt in the fis 
4 
' sity of Michigan ; 
NTON, NORMAN, AND WORCESTER, DEAN A tn 1 ( hie to Educat 
Vea rements. Boston, Ginn and Cor pany, 1928 \ 144 7 
; In the six chapters of this small | k the aut e pre | 
| language the essential facts which university instructors | 
takir , ree 1 ed +; bs 
the theoretic | ti mlic t ns ne | 
een. anch an in th . f ' ‘ 
ent e! er} il In tl] int ¢ 
re i 1 achievement tests thev | ve t togeti 
T f son f the commonest « ~ T the . % 








the rf 
lure f 
e findiy 
‘ teache 


if anythir 
ure cComir 
1] 
Teliicence 
ad 
those wi 


ed to ask whether the book may not aid in continuing the pernicious pr: 


‘ giving tests just for the sake of doing the popular thing instead 
y problems and aiding in their solution. The book is to be criti 
at it does not contain; what it does contain is thoughtfully done 
writter There are several books covering the measurement field al 
lequately Why add another unless it makes a contribution? 
West Mints Demustinens of Disatl W. W. Cox 
> J B.. AND GILLILAND. A. R in Introduction to Psycholo 
N } Macmillan Company, 1927. ix 319 py 
lr} two professors of psychology at Northwestern University who 
this textbook for use by high-school students have done an excell 
work As would be expected, disputat s material is omitted, and t 
t 1] s in the main the traditional lines, wit! chapte rs on such stand 
es the nervous system, reflexes, habit, sensations, attention, percept 
! imagination, and reasoning Psychological method is bri fl 
pon in the intr tory sections, wherein there is also an excell 
t t the purposes and technique of science at large. Borderla 
re san discussed in chapters or sections on sleep, drear 
ot t} cht-transferenes ind superstitior The best chapters, t 
iy ‘ ? T thy t 14 »] | y wi eT ot ns iT j erie rt 
rT neral plan of presentation is to preface each chapter with an out 
t tents (how much better than to relegate it to a summary at the cl 


g, which can be considered as a contribution. Some phases of testir 
g to be recognized which are searcely suggested. The value of ir 
tests as an aid to teaching is being increasingly questioned. 
tend to distinguish sharply between tests suitable for the a 
r, the supervisor, and the teacher, the book is painfully lacking 
ggestions. The value of tests for purposes of diagnosis and 
remedial instruction is mentioned, but no adequate suggestions 
he discussion of grouping on the basis of test results is not spe 
les no statement of the principles involved; one is led to infer that 
rs are most interested in acquainting the reader with procedur 
an helping him to solve a problem. So many of the most hel; 
uses of tests are omitted or inadequately discussed that one 


‘urrent writings and practices but possibly does not show a con plet 


complex procedures. The final chapter suggests a form and pr 
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he local construction of new-type examinations summarizes som: 


that phase of test construction. The chapter on statistics show 


out the simple processes and explains briefly a few terms relati: 


udying the child from all angles and for recording permanently 
rhe point of view of the whole book is that of using tests to giv 
n understanding of individual children. 


om the fact that the book is unusually well written, there is littl 
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ost authors do!), to head each paragraph with an italicized statement of 
port, and to conclude each chapter with a dozen or twenty questions and 
four references to well-known texts. From a lite rary point of view the 
tation is satisfactory. The book could be read more easily, however, 
veral hundred commas and semicolons could be judiciously sprinkled about 
ages. It may be the publisher ’s idea that it interests the reader to keep 
suessing where the various portions of a compound sentence start and stop. 
A favorite indoor sport of reviewers is to tell the authors what they might 
] 


written in place of what they did write. I reeall one reviewer who used 


s space for that. I must forego this pleasure, for, after all, no two 


ns would a 


oO 
= 


ree as to what ought to be put in a psychology for high-school 
nts and what ought to be omitted. However, I shall permit myself to 

question here a few statements that seem to me unjustified, if not 
ially erroneous, I refer to the implication (p. 181) that a poor reade 
better his reading by deliberately trying to move his eyes differently; to 
injunction ‘‘ Never try to fight distractions’’ (p. 143, whereon the illus 


n seems to me not to fit the point); to the use (p. 211) of ‘‘immediate 


ry’’ as synonymous with ‘‘ fleeting memory’’; to the attempt to prove it 
to study by quoting figures (p. 201) on the continuance of high-school 
astic success in college; to the recommendation (p. 216), with no quali 
ns, of the ‘‘whole’’ method of memorizing; and to the injunction 
228) not to try to recall a thing when you can’t seem to do so. Thess 
uacies f such they be—are trivial in comparison with the numerous 


ts of this new textbook. 


Guy M. WHIPPLI 
s, Massac husetts ; 


. GERALD S Certain Techn yues Used in Developwnag a Course of Study in 
SCULONCE for the Horac é Ma n k lementar U Ni hool. Ne Ww \ ork, Te acners 
College, Columbia University, 19: 


ia University, Contributions to Education, No, 276 


Dr. Craig first made an investigation of several hundred courses in nature 
it found that ‘‘the outstanding characteristic of the nature study a 
. ry? rra lementar »} ] ry h lack f , ' ‘ 
e | grams in elementary schools seems to t ack ¢ g 1Za 
+} 


inquired, ‘‘ What are the contributions of science which are such an 


rtant part of our social heritage that they should be passed on from 


ition to generation?’’ With this point in! nd he adoy ted three major 

s for elementary science in the grades. These were, first, to present thos 
tific conceptions which, when understood, greatly influence the thought 
f the individual and which have modified thinking in many fields; 

1, to impart those habits, skills, and information in science ‘‘that are 


ant because of their function in establish y health, economy and satety 


te and public life’’; and third, to give ‘‘those facts, principles, get 
ations and hypotheses of science which are essential to an interpretation 


ral phenomena which commonly challenge children 
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Under these goals were listed specific objectives which are ‘‘ definite enough 


suggest and define instructional materials.’’ The objectives were obtained 
from The Nature Study Review, courses of study in elementary science, source 
ks in nature study, and similar professional literature and authoritative 


treatises on science, all of which are named in the Appendix. 


The list was submitted to 188 laymen for evaluation on the basis of the 


e they have made of them in their own experiences and the 88 specific objec 


ranked on the basis of these returns. To rank them in the order 


we 
f importance as determined by nearly seven hundred questions secured by 


en in Grades I to VIL was next undertaket Finally the author attempte 

to evaluate the in portance of the speci fic ol jectives in terms of the use made 
them in authoritative treatises on smence 

It is a Joy to find a book that endeavors to secure a fact foundation for 

he selection of the science materials of the grades. The author himself points 


out the many studies that will be required before the factual material is ade 


quate to make final safe judgments upon the matter. The book, however, is a 
long step in the right direction, and the science program for the Horace Mant 


I ementary School is being built on the results of the study. 
University of Chicago ELuiotTt R. DOWNING 
PUBLICATIONS RECEIVED, FEBRUARY 15 TO MARCH 15 
BOOKS FOR EDUCATIONAL EXECUTIVES 


I rgeson, -. @& The administration of elementary and secondary education 


Swed New York, Teachers College, Columbia Univ., 1927. 231 py 
Contributions to education, no. 278 Cloth, $1.50. Paper, $1.25. 

Brubacher, J. S The judicial power of the New York state commissioner « 
lucation; its growth and present status with a digest of decisions. New 
York, Teachers College, Columbia Uniy., 1927. 173 pp (Contributions t 

ed ation, no, 205 Cloth, $1.50. Pape r, $1.25. 

R. L Veasurement of th need for transpo ting pups » basis 
tate equalization of transportation costs New York, Teachers College 
(1 mbia Univ., 1927. 61 pp. Contributions to education, no. 2S8Y 
( $1.50 Pape $1.25. 

} D ve prograr of currtculum revisior Denve r. Ce lo ‘ Board of Eduea 


ition, 1927. 103 pp. Monograph no, 12 
vu l. Ne M The Method st Episcopal Church and education up to 1st 


New York, Teachers College, Columbia Univ., 1928. 127 pp. (Contril 
t ns to education, no. 284) Cloth, $1.50. Paper, $1.25. 
Engelhardt, Fred, and Goldthorpe, J. H. Building program, dustin publu 


hools, Austin, Minnesota. Minneapolis, Minn., Univ. of Minnesota, 1927 


4 py Educational monograph, no. 16) $.50. 
Harap, He ry Th technique of ¢ iculum makina. New York, Macmillan 
128 lS pp. $1.80 
Holzinger, K. J Statistical methods for students in education. joston, Gin 
1Y2s 72 pr Bh. 
ett, [. A English in state teachers colleges; a catalogue study. Né 
York, Teachers College, Columbia Univ., 1927 176 pp. (Contribution 
to education, no. 286 Cloth, $1.50 Paper, $1.25 


G. B Oraanization of the 7 qui cd pl ysical education for women t 
te niversilies New York, Teachers College, Columbia Univ., 1927 


pp (Contributions to edueation, no. 253) Cloth, $1.50. Paper, $1.2 
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to find a new book which attempts to be really constructive.” 
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MARION OLIVE LERRIGO 


Staff Associate, American Child Health Association 


A manual of graded standards of habits, attitudes, and knowledge 
conducive to health of the physical organism and to health of person- 
ality, home, community, and race, designed for use by teachers, super- 
visors, and any others who may be teaching, planning, or administering 
programs of health education. This manual should be of helpful 
interest to parents who are ready to co-operate intelligently with 


teachers for the more effective education of their children. 


PRICE, $2.00 POSTPAID 





HEALTH BEHAVIOR SUPPLEMENT 


A manual of practical suggestions for teachers and supervisors in 
administering health education programs with special reference to the 
objectives listed in HEALTH BEHAVIOR. This manual is complete 
with illustrations and record blanks for assembling and recording 


health information in the classroom. 


PRICE 50 CENTS, POSTPAID 


PUBLIC SCHOOL PUBLISHING COMPANY 
BLOOMINGTON, ILLINOIS 























